WP30: E4 chains (7,200 trials) and E5 fan-in (1,600) complete, results sections for handoffs/fan-in/hosted/network/frontier/router, figure fixes
Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
57 changed files +8,088 −298
modified
Makefile
+4 −1
@@ -1,6 +1,9 @@ | ||
| 1 | 1 | .PHONY: paper reproduce-analysis test clean-paper |
| 2 | 2 | PY=.venv/bin/python |
| 3 | −paper: | |
| 3 | +paper: figures-sync | |
| 4 | +figures-sync: | |
| 5 | + cp results/figures/*.pdf paper/figures/ 2>/dev/null || true | |
| 6 | + | |
| 4 | 7 | cd paper && latexmk -pdf -interaction=nonstopmode -halt-on-error main.tex >/dev/null && cp main.pdf WP30_Boucher_Cache_Compression_Knowledge_Transfer.pdf && echo "paper/WP30_Boucher_Cache_Compression_Knowledge_Transfer.pdf" |
| 5 | 8 | reproduce-analysis: |
| 6 | 9 | $(PY) -m wp30 analyze --protocol protocol/frozen.json && $(PY) -m wp30.analysis.static_tables && $(PY) -m wp30 audit-artifacts --root . |
added
paper/figures/fig2_quality_vs_bytes.pdf
+0 −0
Binary file not shown.
added
paper/figures/fig3_quality_vs_latency_memory.pdf
+0 −0
Binary file not shown.
added
paper/figures/fig4_latency_decomposition.pdf
+0 −0
Binary file not shown.
added
paper/figures/fig5_handoffs.pdf
+0 −0
Binary file not shown.
added
paper/figures/fig6_breakeven.pdf
+0 −0
Binary file not shown.
added
paper/figures/fig7_router.pdf
+0 −0
Binary file not shown.
added
paper/figures/figA_quality_vs_bytes_aware.pdf
+0 −0
Binary file not shown.
added
paper/figures/figA_quality_vs_bytes_blind.pdf
+0 −0
Binary file not shown.
modified
paper/main.pdf
+0 −0
Binary file not shown.
modified
paper/sections/results_fanin.tex
+33 −1
@@ -1 +1,33 @@ | ||
| 1 | −% pending | |
| 1 | +\subsection{Fan-in, composition and conflicting evidence (E5)} | |
| 2 | +\label{sec:fanin} | |
| 3 | +Each of 20 synthetic test documents was partitioned among $k\in\{2,4\}$ source agents (project blocks round-robin), one source received an | |
| 4 | +additional \emph{superseded} revision sentence for a project also held by another source (a conflict that the ledger's date-precedence rule | |
| 5 | +resolves), and the last source received an irrelevant block from another document. An aggregator (Qwen2.5-3B) answered the multi-hop, | |
| 6 | +aggregation, revision, temporal and unanswerable questions (8 per document; 1\,600 trials, no failures) from one of five compositions | |
| 7 | +(Table~\ref{tab:fanin}): the concatenated source texts (reference), concatenated 512-token summaries, merged structured records with the | |
| 8 | +precedence rule stated, a shared-memory index with metered retrieval (at most three lookups and 1\,500 bytes per source), and a | |
| 9 | +\emph{negative control} that concatenates the KV caches of the independently prefilled sources along the position axis---an operation that | |
| 10 | +is not valid by construction (overlapping positions, no cross-source context during prefill) and is reported only as a diagnostic. | |
| 11 | + | |
| 12 | +\begin{table}[t]\centering\scriptsize | |
| 13 | +\caption{Fan-in accuracy (\%, 95\,\% cluster-bootstrap CI) by composition method and question type; $k$ = number of source agents. Twenty | |
| 14 | +documents; multi-hop and revision 40 trials per cell, aggregation and temporal 20, unanswerable 40.}\label{tab:fanin} | |
| 15 | +\adjustbox{max width=\textwidth}{\input{tables/table_fanin}} | |
| 16 | +\end{table} | |
| 17 | + | |
| 18 | +\paragraph{Prose composes; structured records and references do not, at this budget.} Concatenated summaries match the full-context reference | |
| 19 | +on multi-hop joins (92 vs 95--98\,\%) and on the conflicting revisions (65--70 vs 60--62\,\%: the summaries carry the dates, and the aggregator | |
| 20 | +applies the precedence rule as well from summaries as from the sources). Merged structured records fall to 22--32\,\% on multi-hop and | |
| 21 | +15--45\,\% on revisions, again because each 512-token extraction covers only part of its source, and a join needs both parts. Shared memory with | |
| 22 | +metered retrieval improves with more sources (38 $\to$ 60\,\% multi-hop, 45 $\to$ 68\,\% revision from $k=2$ to $k=4$) because more references | |
| 23 | +exist to be fetched, at 1.4--3.3~kB of fetched source per question on top of a 3--6~kB index. Every method abstained correctly on the | |
| 24 | +unanswerable questions (98--100\,\%), including those about the irrelevant block's projects, and no method---not even the full-context | |
| 25 | +reference---solved the numerical aggregation (0\,\% everywhere): summing five to six seven-digit amounts is beyond the 3B aggregator regardless | |
| 26 | +of representation, a receiver limit rather than a communication effect. | |
| 27 | + | |
| 28 | +\paragraph{The cache-concatenation control is not zero, and that is the warning.} Feeding the aggregator two independently built caches laid | |
| 29 | +end to end gave 70\,\% on multi-hop and 50\,\% on revisions at $k=2$, falling to 52 and 25\,\% at $k=4$ (Table~\ref{tab:fanin}). Attention can | |
| 30 | +still find a fact whose key happens to be reachable, so a shape-compatible but semantically invalid composition produces plausible answers | |
| 31 | +instead of failing loudly; this is exactly the failure mode that compatibility manifests must prevent, and it is why we report the control | |
| 32 | +as a diagnostic and not as a method. A valid cache composition would need either re-encoding with consistent positions (i.e., a fresh prefill) | |
| 33 | +or a composition-aware method, none of which was available for these models. | |
modified
paper/sections/results_frontier.tex
+103 −1
@@ -1 +1,103 @@ | ||
| 1 | −% pending | |
| 1 | +\subsection{Single-handoff compression frontier (E1)} | |
| 2 | +\label{sec:results-frontier} | |
| 3 | +Table~\ref{tab:primary} and Figure~\ref{fig:frontier} summarize the core campaign: 160 test documents, 22 conditions, two model pairs, | |
| 4 | +13\,280 scheduled trials, all executed; 74 attempts ended as \emph{invalid output} (empty or non-text generations, all from 4-bit Qwen caches and | |
| 5 | +random eviction) and 240 as \emph{implementation error} (LLMLingua-2 on the Llama pair: the cluster node lacked the PyTorch runtime; those | |
| 6 | +trials were retried on the laptop and both attempts are kept, Appendix~\ref{app:tables}). Failures count as zero quality. | |
| 7 | + | |
| 8 | +\begin{figure}[p]\centering\includegraphics[width=\textwidth]{fig2_quality_vs_bytes.pdf} | |
| 9 | +\caption{Quality against measured serialized payload bytes (log scale), by task family (columns) and model pair (rows). Each point is one | |
| 10 | +condition (median payload, mean quality, 95\,\% cluster-bootstrap CI). Text methods cluster at $10^2$--$10^4$ bytes, cache methods at | |
| 11 | +$10^7$--$10^9$ bytes: a 3B-parameter cache of a document is three to four orders of magnitude larger than the document. Question-aware and | |
| 12 | +question-blind conditions are both shown here; Appendix figures separate them.}\label{fig:frontier}\end{figure} | |
| 13 | + | |
| 14 | +\begin{table}[p]\centering\scriptsize | |
| 15 | +\caption{Primary comparison: quality (\%, with 95\,\% cluster-bootstrap CI) per condition, family and pair. Synthetic = private-fact accuracy | |
| 16 | +(5 questions per document: single fact, exact copy, multi-hop), exec = hidden-test pass (all 5 tests), QASPER/2Wiki = LongBench F1. | |
| 17 | +``blind''/``aware'' = question access of the compressor. Latency and bytes for the synthetic family in Table~\ref{tab:cost}.}\label{tab:primary} | |
| 18 | +\adjustbox{max width=\textwidth}{\input{tables/table_primary}} | |
| 19 | +\end{table} | |
| 20 | + | |
| 21 | +\paragraph{Lossless representations are interchangeable; nothing else is.} Full text (A1), zstd-compressed text (A7), the native cache | |
| 22 | +(B0), the serialized and reloaded cache (B1) and the 8-bit packed cache (B2-8) give the same answers within noise on every family and pair | |
| 23 | +(T2: B2-8 vs B0 \DiffTW{} points, Holm $p=\PTW$; T6: A1 vs B0 $p=\PTX$; $n=\NTW$ paired instances each). This is the expected | |
| 24 | +consistency result---the cache \emph{is} the document as the receiver read it---and it is also the only region of the frontier where | |
| 25 | +representation choice is free of quality cost. The A7 result confirms H8: the codec shrinks the text payload ${\approx}3.5\times$ | |
| 26 | +(\BSyntheticQwenAO{} bytes raw for an average synthetic document) with no effect on quality or receiver time, while on bf16 caches zstd saves | |
| 27 | +${\approx}20$\,\% (Section~\ref{sec:network}). | |
| 28 | + | |
| 29 | +\paragraph{Packed 4-bit quantization is model-dependent (H2 confirmed).} At 4 bits with 64-element groups, Llama-3.2-3B keeps | |
| 30 | +\QSyntheticLlamaBWBitsF{}\,\% accuracy on private facts and \QExecLlamaBWBitsF{}\,\% on executable tasks, whereas Qwen2.5-3B collapses to | |
| 31 | +\QSyntheticQwenBWBitsF{}\,\% and \QExecQwenBWBitsF{}\,\% (T3, both pairs pooled: \DiffTH{} points, Holm $p=\PTH$). The failure is total | |
| 32 | +(garbled tokens, 29 empty generations), it reproduces in the native \texttt{mlx-lm} path, and it is the per-token affine quantization of Qwen's | |
| 33 | +outlier key channels that KIVI's per-channel scheme was designed to avoid. Eight bits are safe for both models; halving the cache is therefore | |
| 34 | +free for both, quartering it is free for one. | |
| 35 | + | |
| 36 | +\paragraph{Eviction without the question is destructive; eviction with the question is nearly free---for retrieval, not for code.} Keeping a | |
| 37 | +quarter of the positions by the sink-plus-recent rule (B3) leaves \QSyntheticQwenBHK{}\,\% (Qwen) and \QSyntheticLlamaBHK{}\,\% (Llama) on | |
| 38 | +private facts, close to the share of facts that happen to sit in the retained window; random retention (B4) is at zero and produces | |
| 39 | +incoherent output on both models. The SnapKV-style rule with the question as observation window (B5-aware) recovers \QSyntheticQwenBVKAware{}\,\% | |
| 40 | +(Qwen) and \QSyntheticLlamaBVKAware{}\,\% (Llama) at the same 1/4 budget (T4 vs B3: \DiffTF{} points, Holm $p=\PTF$, H3 confirmed in its | |
| 41 | +first half), and the pyramid allocation (B6) and the selection-plus-8-bit composition (B9) behave like B5. With a generic window instead of | |
| 42 | +the question (B5-blind) the same algorithm falls to \QSyntheticQwenBVKBlind{}\,\%/\QSyntheticLlamaBVKBlind{}\,\%: attention-based selection | |
| 43 | +is a \emph{question-aware} method and must be compared as one (H7). On the executable family every eviction method, aware or not, scores | |
| 44 | +zero on both models: a code specification cannot be quartered, because every rule in the ticket matters for the hidden tests. On the public | |
| 45 | +QA subsets eviction costs little (the answers are short spans), but the F1 ceiling of 3B receivers is low (A1 $\approx$ 0.25--0.39). | |
| 46 | + | |
| 47 | +\paragraph{Text compression at a 512-token budget: summaries beat structured evidence, extraction beats both when the question is known.} | |
| 48 | +Question-blind summaries (A4) retain \QSyntheticQwenAFBBlind{}\,\% (Qwen) and \QSyntheticLlamaAFBBlind{}\,\% (Llama) of the private-fact | |
| 49 | +answers; structured JSON evidence with spans (A5) only \QSyntheticQwenAVBBlind{}\,\%/\QSyntheticLlamaAVBBlind{}\,\% (T1: \DiffTO{} points, | |
| 50 | +Holm $p=\PTO$, $n=\NTO$). H1's expectation that typed facts would protect identifiers and numbers is \emph{rejected} at this budget: the | |
| 51 | +sender spends its 512 output tokens on exact quotes (provenance) and emits ${\approx}8$ facts out of 62 per document, so most answers are | |
| 52 | +simply absent from the message; the receiver answers ``unknown'' (correctly abstaining) rather than hallucinating. References plus metered | |
| 53 | +retrieval (A6) repair little (\QSyntheticQwenAXBRBlind{}\,\%/\QSyntheticLlamaAXBRBlind{}\,\%) because the reference index inherits the same | |
| 54 | +coverage. Deterministic extraction (A3) is the strongest cheap method: blind centrality selection keeps \QSyntheticQwenAHBBlind{}\,\%, and with | |
| 55 | +the question (BM25) \QSyntheticQwenAHBAware{}\,\%/\QSyntheticLlamaAHBAware{}\,\%---indistinguishable from full text at 1/15 of the bytes. | |
| 56 | +Head/tail truncation (A2) keeps exactly the facts that fall in the kept windows (\QSyntheticQwenAWB{}\,\%). On the executable family the | |
| 57 | +ordering changes: blind extractive selection keeps the whole specification (\QExecQwenAHBBlind{}\,\%/\QExecLlamaAHBBlind{}\,\%) because the | |
| 58 | +rules are dense in digits and identifiers, and the Llama summary preserves the rules better than the Qwen summary | |
| 59 | +(\QExecLlamaAFBBlind{} vs \QExecQwenAFBBlind{}\,\%). LLMLingua-2 (A8) at the same rate removes the very tokens the questions ask for | |
| 60 | +(\QSyntheticQwenAEBBlind{}\,\% on private facts, 0 on code) while being competitive on QASPER (\QQasperQwenAEBBlind{} vs | |
| 61 | +\QQasperQwenAO{}\,\% F1 for full text): a compressor trained on meeting transcripts is tuned for paraphrasable content, not for exact values. | |
| 62 | + | |
| 63 | +\paragraph{Cost accounting changes the ranking (RQ3).} Table~\ref{tab:cost} gives, for the synthetic family, the median serialized bytes and | |
| 64 | +the cold and warm per-query latencies assembled from the recorded spans. In bytes, every text method beats every cache method by | |
| 65 | +$10^3$--$10^4$. In cold latency on the laptop (Qwen pair), full text costs \TcoldSyntheticQwenAO{}~ms per question (prefill of the whole | |
| 66 | +document each time), the native cache \TcoldSyntheticQwenBZ{}~ms (document prefill once plus the fresh question), and a blind summary | |
| 67 | +\TcoldSyntheticQwenAFBBlind{}~ms---the sender's generation dominates. In the warm, reused regime the ranking inverts: the cache answers a new | |
| 68 | +question in \TwarmSyntheticQwenBZ{}~ms and the 8-bit cache in \TwarmSyntheticQwenBWBitsE{}~ms, the summary in \TwarmSyntheticQwenAFBBlind{}~ms | |
| 69 | +(it is short), while full text still pays \TwarmSyntheticQwenAO{}~ms. Peak memory separates two phases (Table~\ref{tab:primary} sources; Figure~\ref{fig:latency}, bottom): the \emph{prefill} peak is the | |
| 70 | +same for every cache method as for full text (7.16~GB on the laptop with both models resident), because compression happens after the | |
| 71 | +document has been read---a method that compresses after prefill cannot lower the prefill peak; the \emph{decode-phase} peak then reflects the | |
| 72 | +resident state (6.90~GB for the dense Qwen cache, 6.74 at 8 bits, 6.55 at 1/4 retention, 6.3--6.6 for text messages), i.e., ${\approx}0.3$~GB | |
| 73 | +for an 8k-token Qwen cache and three times that for Llama's eight KV heads. No single denominator ranks the methods the same way; the frontier maps (Figures~\ref{fig:frontier} and | |
| 74 | +\ref{fig:latency}) are the result. | |
| 75 | + | |
| 76 | +\begin{table}[t]\centering\scriptsize | |
| 77 | +\caption{Resource accounting, synthetic family (medians over trials). Cold = build + compress/serialize + load + receiver; warm = load + | |
| 78 | +receiver (document state already built); bytes = serialized payload including manifest. Qwen pair on the laptop (M5 Max); Llama pair on | |
| 79 | +M3U96a (M3 Ultra) for this family---compare within a pair only.}\label{tab:cost} | |
| 80 | +\begin{tabular}{@{}lrrrrrr@{}}\toprule | |
| 81 | + & \multicolumn{3}{c}{Qwen2.5-3B (laptop)} & \multicolumn{3}{c}{Llama-3.2-3B (M3U96a)} \\ | |
| 82 | +Condition & bytes & cold ms & warm ms & bytes & cold ms & warm ms \\\midrule | |
| 83 | +A1 full text & \BSyntheticQwenAO & \TcoldSyntheticQwenAO & \TwarmSyntheticQwenAO & \BSyntheticLlamaAO & \TcoldSyntheticLlamaAO & \TwarmSyntheticLlamaAO \\ | |
| 84 | +A4 summary (blind) & \BSyntheticQwenAFBBlind & \TcoldSyntheticQwenAFBBlind & \TwarmSyntheticQwenAFBBlind & \BSyntheticLlamaAFBBlind & \TcoldSyntheticLlamaAFBBlind & \TwarmSyntheticLlamaAFBBlind \\ | |
| 85 | +A5 structured (blind) & \BSyntheticQwenAVBBlind & \TcoldSyntheticQwenAVBBlind & \TwarmSyntheticQwenAVBBlind & \BSyntheticLlamaAVBBlind & \TcoldSyntheticLlamaAVBBlind & \TwarmSyntheticLlamaAVBBlind \\ | |
| 86 | +A7 zstd text & \BSyntheticQwenASZstd & \TcoldSyntheticQwenASZstd & \TwarmSyntheticQwenASZstd & \BSyntheticLlamaASZstd & \TcoldSyntheticLlamaASZstd & \TwarmSyntheticLlamaASZstd \\ | |
| 87 | +B0 native cache & \BSyntheticQwenBZ & \TcoldSyntheticQwenBZ & \TwarmSyntheticQwenBZ & \BSyntheticLlamaBZ & \TcoldSyntheticLlamaBZ & \TwarmSyntheticLlamaBZ \\ | |
| 88 | +B1 serialized reuse & \BSyntheticQwenBO & \TcoldSyntheticQwenBO & \TwarmSyntheticQwenBO & \BSyntheticLlamaBO & \TcoldSyntheticLlamaBO & \TwarmSyntheticLlamaBO \\ | |
| 89 | +B2 8-bit & \BSyntheticQwenBWBitsE & \TcoldSyntheticQwenBWBitsE & \TwarmSyntheticQwenBWBitsE & \BSyntheticLlamaBWBitsE & \TcoldSyntheticLlamaBWBitsE & \TwarmSyntheticLlamaBWBitsE \\ | |
| 90 | +B3 sink+recent 1/4 & \BSyntheticQwenBHK & \TcoldSyntheticQwenBHK & \TwarmSyntheticQwenBHK & \BSyntheticLlamaBHK & \TcoldSyntheticLlamaBHK & \TwarmSyntheticLlamaBHK \\ | |
| 91 | +B5 attention 1/4 (aware) & \BSyntheticQwenBVKAware & \TcoldSyntheticQwenBVKAware & \TwarmSyntheticQwenBVKAware & \BSyntheticLlamaBVKAware & \TcoldSyntheticLlamaBVKAware & \TwarmSyntheticLlamaBVKAware \\ | |
| 92 | +B6 pyramid 1/4 (aware) & \BSyntheticQwenBXKAware & \TcoldSyntheticQwenBXKAware & \TwarmSyntheticQwenBXKAware & \BSyntheticLlamaBXKAware & \TcoldSyntheticLlamaBXKAware & \TwarmSyntheticLlamaBXKAware \\\bottomrule | |
| 93 | +\end{tabular} | |
| 94 | +\end{table} | |
| 95 | + | |
| 96 | +\begin{figure}[t]\centering\includegraphics[width=\textwidth]{fig3_quality_vs_latency_memory.pdf} | |
| 97 | +\caption{Quality against cold end-to-end latency (top) and peak MLX memory during the trial (bottom), by family, both pairs pooled.} | |
| 98 | +\label{fig:latency}\end{figure} | |
| 99 | + | |
| 100 | +\begin{figure}[t]\centering\includegraphics[width=\textwidth]{fig4_latency_decomposition.pdf} | |
| 101 | +\caption{Latency decomposition (medians of recorded spans, synthetic family, cold scenario; document build counted once). Sender generation | |
| 102 | +dominates the text methods that need a model; document prefill dominates the cache methods; selection and serialization are minor; the | |
| 103 | +pyramid cache pays a token-by-token query prefill.}\label{fig:decomp}\end{figure} | |
modified
paper/sections/results_handoffs.tex
+40 −1
@@ -1 +1,40 @@ | ||
| 1 | −% pending | |
| 1 | +\subsection{Repeated handoffs and error correction (E4)} | |
| 2 | +\label{sec:handoffs} | |
| 3 | +Twenty synthetic test documents were relayed through chains of 1, 2, 4 and 8 handoffs (Figure~\ref{fig:handoffs}, Table~\ref{tab:handoffs}). | |
| 4 | +Only the first agent sees the document; every later agent sees only the previous message (closed) or the previous message plus metered | |
| 5 | +re-reads of source sentences for the project codes it mentions (repairable; at most four lookups and 1\,500 bytes per hop). Both prose (A4) | |
| 6 | +and structured (A5) relays were run with a homogeneous Qwen chain and with a Qwen/Llama alternating chain; after each measured hop the last | |
| 7 | +agent answered all fifteen question types, and the evaluator-only ledger (62 atomic facts per document) measured retention and unsupported | |
| 8 | +additions in each message. 7\,200 answer trials were produced. | |
| 9 | + | |
| 10 | +\begin{figure}[t]\centering\includegraphics[width=\textwidth]{fig5_handoffs.pdf} | |
| 11 | +\caption{Repeated handoffs on 20 synthetic test documents: retained ledger facts, unsupported numbers/identifiers per message, and question | |
| 12 | +accuracy after 1, 2, 4 and 8 handoffs. Solid = closed chains, dashed = repairable chains with metered source lookups; filled circles = Qwen | |
| 13 | +only, open squares = Qwen/Llama alternating.}\label{fig:handoffs}\end{figure} | |
| 14 | + | |
| 15 | +\begin{table}[t]\centering\scriptsize | |
| 16 | +\caption{Repeated handoffs (means over 20 documents; 95\,\% cluster-bootstrap CIs). Retention = share of the 62 ledger facts whose value appears | |
| 17 | +in the message; unsupported = numbers ($\ge$ 4 digits) or identifiers in the message that do not occur in the document; fetched = cumulative | |
| 18 | +bytes re-read from the source by repairable agents.}\label{tab:handoffs} | |
| 19 | +\adjustbox{max width=\textwidth}{\input{tables/table_handoffs}} | |
| 20 | +\end{table} | |
| 21 | + | |
| 22 | +\paragraph{The loss happens at the first hop; relays are nearly lossless afterwards (H5 rejected).} A 512-token prose summary retains | |
| 23 | +${\approx}32$\,\% of the ledger facts and supports ${\approx}40$\,\% of the answers after one handoff; after eight closed handoffs the figures are | |
| 24 | +${\approx}31$\,\% and ${\approx}39$\,\%---a drift of one to two points, within the intervals. Structured relays are even more stable: from hop~2 the | |
| 25 | +Qwen chain re-emits a byte-identical JSON (709 bytes) at every hop, a fixed point of the ``re-emit this evidence'' instruction. The | |
| 26 | +registered expectation of monotone decay below 70\,\% retention after four hops is rejected for both representations, and so is the | |
| 27 | +expectation that structured evidence would protect facts better than prose: at four handoffs the A5 chain answers 12 points \emph{fewer} | |
| 28 | +questions than the A4 chain (T5, paired difference $-0.12$, 95\,\% CI $[-0.21,-0.03]$, bootstrap $p=0.013$, 300 instances in 20 documents), | |
| 29 | +for the same reason as in the single-handoff study---the budget buys ${\approx}8$ quoted facts. | |
| 30 | + | |
| 31 | +\paragraph{Unsupported additions are rare.} Across 7\,200 relayed messages the ledger metric found no unsupported identifier and at most one | |
| 32 | +unsupported number in a single repairable Qwen chain (0.05 per message); the 3B agents compress by \emph{omission}, not by invention, and the | |
| 33 | +receiver answers ``unknown'' for omitted facts. Alternating Qwen and Llama agents neither helped nor hurt (differences within one point). | |
| 34 | + | |
| 35 | +\paragraph{Metered repair recovers a little at a growing price (H6 partially confirmed).} Allowing each relay agent to re-read the source | |
| 36 | +sentences for the project codes in the notes raised retention from 32 to 38\,\% and accuracy from 40 to 44\,\% for the prose chain, with no | |
| 37 | +further gain after the fourth hop; the cumulative fetched volume reached 5.9~kB by hop~8, i.e., about five messages' worth of traffic for a | |
| 38 | +four-point gain. For the structured chain the repair added two points of retention and nothing in accuracy: the agent could re-read, but the | |
| 39 | +re-emitted JSON did not grow. Evidence access therefore repairs what the previous message still \emph{names}; facts whose entity was already | |
| 40 | +dropped cannot be requested, which is the practical limit of reference-based repair without the original question. | |
modified
paper/sections/results_network.tex
+8 −8
@@ -21,15 +21,15 @@ deserialization at the worker; the round trip includes the worker's fresh-query | ||
| 21 | 21 | that yields quality~0 for Qwen2.5 (Section~\ref{sec:results-frontier}) and are shown only for byte and time accounting.}\label{tab:network} |
| 22 | 22 | \begin{tabular}{@{}llrrrrr@{}}\toprule |
| 23 | 23 | Context class & Representation & payload (MB) & send & load & remote prefill & round trip \\\midrule |
| 24 | −2k & text $\to$ remote prefill & 0.01 & -- & -- & \EsixTextRemotePrefillNoneTZZZPrefill & \EsixTextRemotePrefillNoneTZZZRt \\ | |
| 25 | −2k & B1 bf16 cache & \EsixBONoneTZZZBytes & \EsixBONoneTZZZSend & \EsixBONoneTZZZLoad & 0 & \EsixBONoneTZZZRt \\ | |
| 26 | −2k & B2 8-bit cache & \EsixBTENoneTZZZBytes & \EsixBTENoneTZZZSend & \EsixBTENoneTZZZLoad & 0 & \EsixBTENoneTZZZRt \\ | |
| 24 | +2k & text $\to$ remote prefill & 0.01 & -- & -- & \EsixTextRemotePrefillNoneWZZZPrefill & \EsixTextRemotePrefillNoneWZZZRt \\ | |
| 25 | +2k & B1 bf16 cache & \EsixBONoneWZZZBytes & \EsixBONoneWZZZSend & \EsixBONoneWZZZLoad & 0 & \EsixBONoneWZZZRt \\ | |
| 26 | +2k & B2 8-bit cache & \EsixBWENoneWZZZBytes & \EsixBWENoneWZZZSend & \EsixBWENoneWZZZLoad & 0 & \EsixBWENoneWZZZRt \\ | |
| 27 | 27 | 8k & text $\to$ remote prefill & 0.03 & -- & -- & \EsixTextRemotePrefillNoneEZZZPrefill & \EsixTextRemotePrefillNoneEZZZRt \\ |
| 28 | 28 | 8k & B1 bf16 cache & \EsixBONoneEZZZBytes & \EsixBONoneEZZZSend & \EsixBONoneEZZZLoad & 0 & \EsixBONoneEZZZRt \\ |
| 29 | −8k & B2 8-bit cache & \EsixBTENoneEZZZBytes & \EsixBTENoneEZZZSend & \EsixBTENoneEZZZLoad & 0 & \EsixBTENoneEZZZRt \\ | |
| 30 | −16k (${\approx}$11k tokens) & text $\to$ remote prefill & 0.06 & -- & -- & \EsixTextRemotePrefillNoneOSZZZPrefill & \EsixTextRemotePrefillNoneOSZZZRt \\ | |
| 31 | −16k & B1 bf16 cache & \EsixBONoneOSZZZBytes & \EsixBONoneOSZZZSend & \EsixBONoneOSZZZLoad & 0 & \EsixBONoneOSZZZRt \\ | |
| 32 | −16k & B2 8-bit cache & \EsixBTENoneOSZZZBytes & \EsixBTENoneOSZZZSend & \EsixBTENoneOSZZZLoad & 0 & \EsixBTENoneOSZZZRt \\\bottomrule | |
| 29 | +8k & B2 8-bit cache & \EsixBWENoneEZZZBytes & \EsixBWENoneEZZZSend & \EsixBWENoneEZZZLoad & 0 & \EsixBWENoneEZZZRt \\ | |
| 30 | +16k (${\approx}$11k tokens) & text $\to$ remote prefill & 0.06 & -- & -- & \EsixTextRemotePrefillNoneOXZZZPrefill & \EsixTextRemotePrefillNoneOXZZZRt \\ | |
| 31 | +16k & B1 bf16 cache & \EsixBONoneOXZZZBytes & \EsixBONoneOXZZZSend & \EsixBONoneOXZZZLoad & 0 & \EsixBONoneOXZZZRt \\ | |
| 32 | +16k & B2 8-bit cache & \EsixBWENoneOXZZZBytes & \EsixBWENoneOXZZZSend & \EsixBWENoneOXZZZLoad & 0 & \EsixBWENoneOXZZZRt \\\bottomrule | |
| 33 | 33 | \end{tabular} |
| 34 | 34 | \end{table} |
| 35 | 35 | |
@@ -37,7 +37,7 @@ Three observations follow. First, the serialized bf16 cache is three to four ord | ||
| 37 | 37 | (\EsixBONoneEZZZBytes{}~MB versus 29~kB at 8k tokens), and zstd recovers only ${\approx}20$\,\% of it (high-entropy payload; H8), while packed |
| 38 | 38 | 8-bit quantization halves it. Second, on this link and with this receiver, moving the cache is nevertheless \emph{faster} than re-reading |
| 39 | 39 | the text at every context length we measured: at 8k tokens the bf16 transfer answers in \EsixBONoneEZZZRt{}~ms against |
| 40 | −\EsixTextRemotePrefillNoneEZZZRt{}~ms for remote prefill, and the 8-bit cache in \EsixBTENoneEZZZRt{}~ms, because the M3~Ultra receiver prefills | |
| 40 | +\EsixTextRemotePrefillNoneEZZZRt{}~ms for remote prefill, and the 8-bit cache in \EsixBWENoneEZZZRt{}~ms, because the M3~Ultra receiver prefills | |
| 41 | 41 | Qwen2.5-3B at ${\approx}0.44$~ms per token (\EsixTextRemotePrefillNoneEZZZPrefill{}~ms for 8k) whereas 1~GbE moves the per-token cache |
| 42 | 42 | (${\approx}26$~kB bf16, ${\approx}14$~kB at 8 bits) in ${\approx}0.23$ and ${\approx}0.12$~ms. The break-even therefore depends on the ratio |
| 43 | 43 | of receiver prefill time to link time per token, which the right panel makes explicit: a faster receiver (the laptop prefills 8k tokens in |
added
paper/tables/table_fanin.tex
+16 −0
@@ -0,0 +1,16 @@ | ||
| 1 | +\begin{tabular}{@{}lrrrrr@{}} | |
| 2 | +\toprule | |
| 3 | +method & aggregation & multi\_hop & revision & temporal & unanswerable \\ | |
| 4 | +\midrule | |
| 5 | +cache concat (neg. control) k=2 & 0 [0,0] & 70 [57,82] & 50 [35,65] & 55 [35,75] & 100 [100,100] \\ | |
| 6 | +cache concat (neg. control) k=4 & 0 [0,0] & 52 [40,68] & 25 [12,40] & 40 [20,60] & 98 [91,100] \\ | |
| 7 | +concat A4 k=2 & 0 [0,0] & 92 [85,99] & 70 [55,85] & 60 [35,80] & 100 [100,100] \\ | |
| 8 | +concat A4 k=4 & 0 [0,0] & 92 [85,100] & 65 [50,80] & 65 [45,85] & 100 [100,100] \\ | |
| 9 | +full context k=2 & 0 [0,0] & 98 [92,100] & 60 [50,71] & 70 [50,90] & 100 [100,100] \\ | |
| 10 | +full context k=4 & 0 [0,0] & 95 [88,100] & 62 [50,75] & 50 [30,75] & 100 [100,100] \\ | |
| 11 | +merge A5 k=2 & 0 [0,0] & 22 [12,35] & 15 [5,25] & 55 [35,80] & 100 [100,100] \\ | |
| 12 | +merge A5 k=4 & 0 [0,0] & 32 [18,48] & 45 [35,55] & 45 [25,65] & 98 [92,100] \\ | |
| 13 | +shared memory A6 k=2 & 0 [0,0] & 38 [22,52] & 45 [30,62] & 35 [20,55] & 100 [100,100] \\ | |
| 14 | +shared memory A6 k=4 & 0 [0,0] & 60 [45,75] & 68 [50,85] & 45 [25,65] & 100 [100,100] \\ | |
| 15 | +\bottomrule | |
| 16 | +\end{tabular} | |
added
paper/tables/table_handoffs.tex
+30 −0
@@ -0,0 +1,30 @@ | ||
| 1 | +\begin{tabular}{@{}llrrrrr@{}} | |
| 2 | +\toprule | |
| 3 | +chain & handoffs & accuracy (\\%) & retained facts (\\%) & unsupported/msg & message B & fetched B \\ | |
| 4 | +\midrule | |
| 5 | +A4 closed Qwen/Llama alt. & 1 & 40 [31,48] & 32 [24,40] & 0.00 & 1,335.10 & 0.00 \\ | |
| 6 | +A4 closed Qwen/Llama alt. & 2 & 40 [33,48] & 32 [24,40] & 0.00 & 1,292.70 & 0.00 \\ | |
| 7 | +A4 closed Qwen/Llama alt. & 4 & 40 [32,48] & 31 [23,39] & 0.00 & 1,204.35 & 0.00 \\ | |
| 8 | +A4 closed Qwen/Llama alt. & 8 & 39 [29,48] & 31 [22,39] & 0.00 & 1,111.65 & 0.00 \\ | |
| 9 | +A4 closed Qwen & 1 & 40 [31,48] & 32 [24,40] & 0.00 & 1,335.10 & 0.00 \\ | |
| 10 | +A4 closed Qwen & 2 & 39 [30,47] & 32 [24,40] & 0.00 & 1,200.35 & 0.00 \\ | |
| 11 | +A4 closed Qwen & 4 & 39 [30,47] & 31 [24,39] & 0.00 & 1,175.65 & 0.00 \\ | |
| 12 | +A4 closed Qwen & 8 & 39 [30,48] & 31 [24,39] & 0.00 & 1,174.70 & 0.00 \\ | |
| 13 | +A4 repairable Qwen & 1 & 40 [31,48] & 32 [24,40] & 0.00 & 1,335.10 & 0.00 \\ | |
| 14 | +A4 repairable Qwen & 2 & 42 [35,50] & 36 [28,42] & 0.05 & 1,283.20 & 844.10 \\ | |
| 15 | +A4 repairable Qwen & 4 & 43 [36,51] & 38 [31,44] & 0.05 & 1,214.45 & 2,532.30 \\ | |
| 16 | +A4 repairable Qwen & 8 & 44 [36,51] & 38 [31,44] & 0.05 & 1,213.50 & 5,908.70 \\ | |
| 17 | +A5 closed Qwen/Llama alt. & 1 & 27 [25,30] & 17 [15,20] & 0.00 & 751.85 & 0.00 \\ | |
| 18 | +A5 closed Qwen/Llama alt. & 2 & 29 [27,33] & 20 [18,22] & 0.00 & 952.65 & 0.00 \\ | |
| 19 | +A5 closed Qwen/Llama alt. & 4 & 29 [26,32] & 20 [18,22] & 0.00 & 977.35 & 0.00 \\ | |
| 20 | +A5 closed Qwen/Llama alt. & 8 & 29 [26,32] & 20 [18,22] & 0.00 & 977.35 & 0.00 \\ | |
| 21 | +A5 closed Qwen & 1 & 27 [25,30] & 17 [15,20] & 0.00 & 751.85 & 0.00 \\ | |
| 22 | +A5 closed Qwen & 2 & 26 [23,29] & 17 [15,20] & 0.00 & 709.10 & 0.00 \\ | |
| 23 | +A5 closed Qwen & 4 & 27 [24,30] & 17 [15,20] & 0.00 & 709.10 & 0.00 \\ | |
| 24 | +A5 closed Qwen & 8 & 27 [24,30] & 17 [15,20] & 0.00 & 709.10 & 0.00 \\ | |
| 25 | +A5 repairable Qwen & 1 & 27 [25,30] & 17 [15,20] & 0.00 & 751.85 & 0.00 \\ | |
| 26 | +A5 repairable Qwen & 2 & 26 [23,29] & 19 [16,21] & 0.00 & 710.50 & 847.60 \\ | |
| 27 | +A5 repairable Qwen & 4 & 26 [24,30] & 20 [17,22] & 0.00 & 743.70 & 2,356.10 \\ | |
| 28 | +A5 repairable Qwen & 8 & 26 [24,30] & 20 [17,22] & 0.00 & 743.70 & 5,373.10 \\ | |
| 29 | +\bottomrule | |
| 30 | +\end{tabular} | |
added
paper/tables/table_primary.tex
+28 −0
@@ -0,0 +1,28 @@ | ||
| 1 | +\begin{tabular}{@{}lrrrrrrrr@{}} | |
| 2 | +\toprule | |
| 3 | +condition & synthetic Qwen & synthetic Llama & exec Qwen & exec Llama & qasper Qwen & qasper Llama & 2wikimqa Qwen & 2wikimqa Llama \\ | |
| 4 | +\midrule | |
| 5 | +A0 & 0 [0,0] & 0 [0,0] & 0 [0,0] & 0 [0,0] & 4 [1,10] & 5 [1,12] & 11 [4,21] & 6 [0,14] \\ | |
| 6 | +A1 & 99 [98,100] & 99 [98,100] & 100 [100,100] & 95 [88,100] & 35 [24,47] & 25 [15,36] & 39 [25,54] & 33 [20,47] \\ | |
| 7 | +A2 512 & 20 [16,23] & 20 [17,24] & 100 [100,100] & 70 [55,85] & 9 [3,16] & 7 [2,13] & 12 [2,22] & 7 [1,15] \\ | |
| 8 | +A3 512 aware & 97 [94,99] & 100 [98,100] & 50 [35,65] & 20 [8,32] & 20 [11,29] & 24 [15,35] & 21 [11,33] & 16 [7,27] \\ | |
| 9 | +A3 512 blind & 38 [36,40] & 40 [40,42] & 100 [100,100] & 98 [92,100] & 18 [8,29] & 14 [7,23] & 11 [2,21] & 3 [0,10] \\ | |
| 10 | +A4 512 aware & 94 [89,98] & 83 [77,90] & -- & -- & -- & -- & -- & -- \\ | |
| 11 | +A4 512 blind & 38 [29,46] & 44 [38,50] & 38 [22,52] & 82 [70,92] & 17 [9,27] & 20 [11,30] & 20 [10,32] & 16 [7,27] \\ | |
| 12 | +A5 512 aware & 100 [100,100] & 95 [91,98] & -- & -- & -- & -- & -- & -- \\ | |
| 13 | +A5 512 blind & 15 [12,18] & 12 [9,16] & 12 [2,22] & 0 [0,0] & 9 [2,18] & 5 [1,11] & 12 [4,23] & 6 [0,13] \\ | |
| 14 | +A6 512 blind & 18 [14,22] & 18 [14,22] & 22 [10,35] & 15 [5,28] & 9 [2,17] & 7 [2,13] & 11 [2,22] & 10 [2,19] \\ | |
| 15 | +A7 zstd & 99 [98,100] & 99 [98,100] & 100 [100,100] & 95 [88,100] & 35 [24,47] & 25 [15,36] & 39 [25,54] & 33 [20,47] \\ | |
| 16 | +A8 512 blind & 14 [9,18] & 0 [0,0] & 0 [0,0] & 0 [0,0] & 17 [10,25] & 23 [13,33] & 6 [0,14] & 8 [0,18] \\ | |
| 17 | +B0 & 99 [98,100] & 99 [98,100] & 100 [100,100] & 95 [88,100] & 35 [24,47] & 25 [15,36] & 36 [22,50] & 33 [20,47] \\ | |
| 18 | +B1 & 99 [98,100] & 99 [98,100] & 100 [100,100] & 95 [88,100] & 35 [24,47] & 25 [15,36] & 36 [22,50] & 33 [20,47] \\ | |
| 19 | +B2 bits=4 & 0 [0,0] & 98 [94,100] & 0 [0,0] & 100 [100,100] & 1 [0,2] & 25 [15,36] & 0 [0,1] & 22 [10,34] \\ | |
| 20 | +B2 bits=8 & 99 [98,100] & 99 [98,100] & 100 [100,100] & 98 [92,100] & 38 [25,50] & 25 [15,36] & 36 [22,50] & 33 [20,47] \\ | |
| 21 | +B3 1/4 & 20 [18,23] & 18 [16,21] & 0 [0,0] & 0 [0,0] & 19 [10,29] & 16 [9,25] & 39 [25,55] & 32 [19,46] \\ | |
| 22 | +B4 1/4 & 0 [0,0] & 0 [0,0] & 0 [0,0] & 0 [0,0] & 6 [2,13] & 7 [1,16] & 1 [0,2] & 0 [0,0] \\ | |
| 23 | +B5 1/4 aware & 78 [72,83] & 98 [96,100] & 0 [0,0] & 0 [0,0] & 29 [19,40] & 24 [15,34] & 34 [20,48] & 32 [19,46] \\ | |
| 24 | +B5 1/4 blind & 12 [8,17] & 19 [12,26] & 0 [0,0] & 0 [0,0] & 21 [11,32] & 19 [10,29] & 31 [18,45] & 28 [16,42] \\ | |
| 25 | +B6 1/4 aware & 66 [61,70] & 98 [95,100] & 0 [0,0] & 0 [0,0] & 27 [16,38] & 24 [15,34] & 36 [23,51] & 29 [16,44] \\ | |
| 26 | +B9 bits=8 1/4 att aware & 78 [73,84] & 98 [96,100] & 0 [0,0] & 0 [0,0] & 28 [18,40] & 24 [14,34] & 35 [22,49] & 32 [19,46] \\ | |
| 27 | +\bottomrule | |
| 28 | +\end{tabular} | |
modified
results/figures/fig2_quality_vs_bytes.pdf
+0 −0
Binary file not shown.
modified
results/figures/fig3_quality_vs_latency_memory.pdf
+0 −0
Binary file not shown.
modified
results/figures/fig3_quality_vs_latency_memory.png
+0 −0
Binary file not shown.
modified
results/figures/fig4_latency_decomposition.pdf
+0 −0
Binary file not shown.
modified
results/figures/fig4_latency_decomposition.png
+0 −0
Binary file not shown.
modified
results/figures/fig5_handoffs.pdf
+0 −0
Binary file not shown.
modified
results/figures/fig5_handoffs.png
+0 −0
Binary file not shown.
modified
results/figures/fig6_breakeven.pdf
+0 −0
Binary file not shown.
modified
results/figures/fig7_router.pdf
+0 −0
Binary file not shown.
modified
results/figures/figA_quality_vs_bytes_aware.pdf
+0 −0
Binary file not shown.
modified
results/figures/figA_quality_vs_bytes_blind.pdf
+0 −0
Binary file not shown.
modified
results/provenance.json
+25 −25
@@ -4,7 +4,7 @@ | ||
| 4 | 4 | "runs/raw/E1_core.jsonl" |
| 5 | 5 | ], |
| 6 | 6 | "script": "src/wp30/analysis/analyze.py", |
| 7 | − "generated_utc": "2026-10-30T08:22:14.538915Z", | |
| 7 | + "generated_utc": "2026-10-30T08:41:10.888608Z", | |
| 8 | 8 | "note": "per-condition quality (cluster bootstrap CI) and resource medians" |
| 9 | 9 | }, |
| 10 | 10 | "results/tables/E1_core_failures.csv": { |
@@ -12,7 +12,7 @@ | ||
| 12 | 12 | "runs/raw/E1_core.jsonl" |
| 13 | 13 | ], |
| 14 | 14 | "script": "src/wp30/analysis/analyze.py", |
| 15 | − "generated_utc": "2026-10-30T08:22:14.540728Z", | |
| 15 | + "generated_utc": "2026-10-30T08:41:10.897925Z", | |
| 16 | 16 | "note": "attempt status counts by method" |
| 17 | 17 | }, |
| 18 | 18 | "results/tables/E1_core_by_question_type.csv": { |
@@ -20,7 +20,7 @@ | ||
| 20 | 20 | "runs/raw/E1_core.jsonl" |
| 21 | 21 | ], |
| 22 | 22 | "script": "src/wp30/analysis/analyze.py", |
| 23 | − "generated_utc": "2026-10-30T08:22:14.760371Z", | |
| 23 | + "generated_utc": "2026-10-30T08:41:11.023256Z", | |
| 24 | 24 | "note": "synthetic accuracy by question type" |
| 25 | 25 | }, |
| 26 | 26 | "results/tables/E1_core_primary_tests.csv": { |
@@ -28,7 +28,7 @@ | ||
| 28 | 28 | "runs/raw/E1_core.jsonl" |
| 29 | 29 | ], |
| 30 | 30 | "script": "src/wp30/analysis/analyze.py", |
| 31 | − "generated_utc": "2026-10-30T08:22:14.878795Z", | |
| 31 | + "generated_utc": "2026-10-30T08:41:11.097268Z", | |
| 32 | 32 | "note": "registered primary comparisons, paired, cluster bootstrap, Holm" |
| 33 | 33 | }, |
| 34 | 34 | "results/figures/fig2_quality_vs_bytes.pdf": { |
@@ -36,7 +36,7 @@ | ||
| 36 | 36 | "runs/raw/E1_core.jsonl" |
| 37 | 37 | ], |
| 38 | 38 | "script": "src/wp30/analysis/analyze.py", |
| 39 | − "generated_utc": "2026-10-30T08:22:15.688835Z", | |
| 39 | + "generated_utc": "2026-10-30T08:41:11.754908Z", | |
| 40 | 40 | "note": "points = conditions; x = median payload bytes; y = mean quality" |
| 41 | 41 | }, |
| 42 | 42 | "results/figures/fig2_quality_vs_bytes.png": { |
@@ -44,7 +44,7 @@ | ||
| 44 | 44 | "runs/raw/E1_core.jsonl" |
| 45 | 45 | ], |
| 46 | 46 | "script": "src/wp30/analysis/analyze.py", |
| 47 | − "generated_utc": "2026-10-30T08:22:15.905436Z", | |
| 47 | + "generated_utc": "2026-10-30T08:41:11.951700Z", | |
| 48 | 48 | "note": "points = conditions; x = median payload bytes; y = mean quality" |
| 49 | 49 | }, |
| 50 | 50 | "results/figures/figA_quality_vs_bytes_blind.pdf": { |
@@ -52,7 +52,7 @@ | ||
| 52 | 52 | "runs/raw/E1_core.jsonl" |
| 53 | 53 | ], |
| 54 | 54 | "script": "src/wp30/analysis/analyze.py", |
| 55 | − "generated_utc": "2026-10-30T08:22:16.400431Z", | |
| 55 | + "generated_utc": "2026-10-30T08:41:12.396339Z", | |
| 56 | 56 | "note": "points = conditions; x = median payload bytes; y = mean quality" |
| 57 | 57 | }, |
| 58 | 58 | "results/figures/figA_quality_vs_bytes_blind.png": { |
@@ -60,7 +60,7 @@ | ||
| 60 | 60 | "runs/raw/E1_core.jsonl" |
| 61 | 61 | ], |
| 62 | 62 | "script": "src/wp30/analysis/analyze.py", |
| 63 | − "generated_utc": "2026-10-30T08:22:16.572977Z", | |
| 63 | + "generated_utc": "2026-10-30T08:41:12.558258Z", | |
| 64 | 64 | "note": "points = conditions; x = median payload bytes; y = mean quality" |
| 65 | 65 | }, |
| 66 | 66 | "results/figures/figA_quality_vs_bytes_aware.pdf": { |
@@ -68,7 +68,7 @@ | ||
| 68 | 68 | "runs/raw/E1_core.jsonl" |
| 69 | 69 | ], |
| 70 | 70 | "script": "src/wp30/analysis/analyze.py", |
| 71 | − "generated_utc": "2026-10-30T08:22:16.948411Z", | |
| 71 | + "generated_utc": "2026-10-30T08:41:12.888916Z", | |
| 72 | 72 | "note": "points = conditions; x = median payload bytes; y = mean quality" |
| 73 | 73 | }, |
| 74 | 74 | "results/figures/figA_quality_vs_bytes_aware.png": { |
@@ -76,7 +76,7 @@ | ||
| 76 | 76 | "runs/raw/E1_core.jsonl" |
| 77 | 77 | ], |
| 78 | 78 | "script": "src/wp30/analysis/analyze.py", |
| 79 | − "generated_utc": "2026-10-30T08:22:17.136598Z", | |
| 79 | + "generated_utc": "2026-10-30T08:41:13.061312Z", | |
| 80 | 80 | "note": "points = conditions; x = median payload bytes; y = mean quality" |
| 81 | 81 | }, |
| 82 | 82 | "results/figures/fig3_quality_vs_latency_memory.pdf": { |
@@ -84,7 +84,7 @@ | ||
| 84 | 84 | "runs/raw/E1_core.jsonl" |
| 85 | 85 | ], |
| 86 | 86 | "script": "src/wp30/analysis/analyze.py", |
| 87 | − "generated_utc": "2026-10-30T08:22:17.472811Z", | |
| 87 | + "generated_utc": "2026-10-30T08:41:13.355100Z", | |
| 88 | 88 | "note": "" |
| 89 | 89 | }, |
| 90 | 90 | "results/figures/fig3_quality_vs_latency_memory.png": { |
@@ -92,7 +92,7 @@ | ||
| 92 | 92 | "runs/raw/E1_core.jsonl" |
| 93 | 93 | ], |
| 94 | 94 | "script": "src/wp30/analysis/analyze.py", |
| 95 | − "generated_utc": "2026-10-30T08:22:17.662871Z", | |
| 95 | + "generated_utc": "2026-10-30T08:41:13.527311Z", | |
| 96 | 96 | "note": "" |
| 97 | 97 | }, |
| 98 | 98 | "results/figures/fig4_latency_decomposition.pdf": { |
@@ -100,7 +100,7 @@ | ||
| 100 | 100 | "runs/raw/E1_core.jsonl" |
| 101 | 101 | ], |
| 102 | 102 | "script": "src/wp30/analysis/analyze.py", |
| 103 | − "generated_utc": "2026-10-30T08:22:17.739355Z", | |
| 103 | + "generated_utc": "2026-10-30T08:41:13.606317Z", | |
| 104 | 104 | "note": "" |
| 105 | 105 | }, |
| 106 | 106 | "results/figures/fig4_latency_decomposition.png": { |
@@ -108,7 +108,7 @@ | ||
| 108 | 108 | "runs/raw/E1_core.jsonl" |
| 109 | 109 | ], |
| 110 | 110 | "script": "src/wp30/analysis/analyze.py", |
| 111 | − "generated_utc": "2026-10-30T08:22:17.782128Z", | |
| 111 | + "generated_utc": "2026-10-30T08:41:13.663220Z", | |
| 112 | 112 | "note": "" |
| 113 | 113 | }, |
| 114 | 114 | "results/figures/fig5_handoffs.pdf": { |
@@ -116,7 +116,7 @@ | ||
| 116 | 116 | "runs/raw/E4_core.jsonl" |
| 117 | 117 | ], |
| 118 | 118 | "script": "src/wp30/analysis/analyze.py", |
| 119 | − "generated_utc": "2026-10-30T08:22:21.811881Z", | |
| 119 | + "generated_utc": "2026-10-30T08:41:18.022870Z", | |
| 120 | 120 | "note": "means over documents; chains defined in configs/chains*.yaml" |
| 121 | 121 | }, |
| 122 | 122 | "results/figures/fig5_handoffs.png": { |
@@ -124,7 +124,7 @@ | ||
| 124 | 124 | "runs/raw/E4_core.jsonl" |
| 125 | 125 | ], |
| 126 | 126 | "script": "src/wp30/analysis/analyze.py", |
| 127 | − "generated_utc": "2026-10-30T08:22:21.866054Z", | |
| 127 | + "generated_utc": "2026-10-30T08:41:18.082563Z", | |
| 128 | 128 | "note": "means over documents; chains defined in configs/chains*.yaml" |
| 129 | 129 | }, |
| 130 | 130 | "results/tables/E4_core_handoffs.csv": { |
@@ -132,7 +132,7 @@ | ||
| 132 | 132 | "runs/raw/E4_core.jsonl" |
| 133 | 133 | ], |
| 134 | 134 | "script": "src/wp30/analysis/analyze.py", |
| 135 | − "generated_utc": "2026-10-30T08:22:21.965647Z", | |
| 135 | + "generated_utc": "2026-10-30T08:41:18.179059Z", | |
| 136 | 136 | "note": "repeated handoffs" |
| 137 | 137 | }, |
| 138 | 138 | "results/tables/E4_core_h4_primary_tests.csv": { |
@@ -140,7 +140,7 @@ | ||
| 140 | 140 | "runs/raw/E4_core.jsonl" |
| 141 | 141 | ], |
| 142 | 142 | "script": "src/wp30/analysis/analyze.py", |
| 143 | − "generated_utc": "2026-10-30T08:22:21.977607Z", | |
| 143 | + "generated_utc": "2026-10-30T08:41:18.190264Z", | |
| 144 | 144 | "note": "registered primary comparisons, paired, cluster bootstrap, Holm" |
| 145 | 145 | }, |
| 146 | 146 | "results/tables/E5_core_fanin.csv": { |
@@ -148,7 +148,7 @@ | ||
| 148 | 148 | "runs/raw/E5_core.jsonl" |
| 149 | 149 | ], |
| 150 | 150 | "script": "src/wp30/analysis/analyze.py", |
| 151 | − "generated_utc": "2026-10-30T08:22:22.071683Z", | |
| 151 | + "generated_utc": "2026-10-30T08:41:18.294190Z", | |
| 152 | 152 | "note": "fan-in by method and question type" |
| 153 | 153 | }, |
| 154 | 154 | "results/figures/fig6_breakeven.pdf": { |
@@ -156,7 +156,7 @@ | ||
| 156 | 156 | "runs/raw/E6_core.jsonl" |
| 157 | 157 | ], |
| 158 | 158 | "script": "src/wp30/analysis/analyze.py", |
| 159 | − "generated_utc": "2026-10-30T08:22:22.167477Z", | |
| 159 | + "generated_utc": "2026-10-30T08:41:18.383673Z", | |
| 160 | 160 | "note": "left = measured (medians, p25-p75); right = analytic model from measured bandwidth and prefill slope; dashed 10 Gb/s is hypothetical" |
| 161 | 161 | }, |
| 162 | 162 | "results/figures/fig6_breakeven.png": { |
@@ -164,7 +164,7 @@ | ||
| 164 | 164 | "runs/raw/E6_core.jsonl" |
| 165 | 165 | ], |
| 166 | 166 | "script": "src/wp30/analysis/analyze.py", |
| 167 | − "generated_utc": "2026-10-30T08:22:22.242714Z", | |
| 167 | + "generated_utc": "2026-10-30T08:41:18.456745Z", | |
| 168 | 168 | "note": "left = measured (medians, p25-p75); right = analytic model from measured bandwidth and prefill slope; dashed 10 Gb/s is hypothetical" |
| 169 | 169 | }, |
| 170 | 170 | "results/tables/E6_network.csv": { |
@@ -172,7 +172,7 @@ | ||
| 172 | 172 | "runs/raw/E6_core.jsonl" |
| 173 | 173 | ], |
| 174 | 174 | "script": "src/wp30/analysis/analyze.py", |
| 175 | − "generated_utc": "2026-10-30T08:22:22.247935Z", | |
| 175 | + "generated_utc": "2026-10-30T08:41:18.462390Z", | |
| 176 | 176 | "note": "two-node transfer measurements" |
| 177 | 177 | }, |
| 178 | 178 | "results/tables/ED_hosted.csv": { |
@@ -180,7 +180,7 @@ | ||
| 180 | 180 | "runs/raw/ED_hosted_core.jsonl" |
| 181 | 181 | ], |
| 182 | 182 | "script": "src/wp30/analysis/analyze.py", |
| 183 | − "generated_utc": "2026-10-30T08:22:22.319194Z", | |
| 183 | + "generated_utc": "2026-10-30T08:41:18.529003Z", | |
| 184 | 184 | "note": "hosted receivers; cost estimated from provider price tables" |
| 185 | 185 | }, |
| 186 | 186 | "results/figures/fig7_router.pdf": { |
@@ -190,7 +190,7 @@ | ||
| 190 | 190 | "runs/checkpoints/router_policy.json" |
| 191 | 191 | ], |
| 192 | 192 | "script": "src/wp30/analysis/analyze.py", |
| 193 | − "generated_utc": "2026-10-30T08:22:22.416428Z", | |
| 193 | + "generated_utc": "2026-10-30T08:41:18.669288Z", | |
| 194 | 194 | "note": "oracle = infeasible upper reference" |
| 195 | 195 | }, |
| 196 | 196 | "results/figures/fig7_router.png": { |
@@ -200,7 +200,7 @@ | ||
| 200 | 200 | "runs/checkpoints/router_policy.json" |
| 201 | 201 | ], |
| 202 | 202 | "script": "src/wp30/analysis/analyze.py", |
| 203 | − "generated_utc": "2026-10-30T08:22:22.507187Z", | |
| 203 | + "generated_utc": "2026-10-30T08:41:18.747352Z", | |
| 204 | 204 | "note": "oracle = infeasible upper reference" |
| 205 | 205 | } |
| 206 | 206 | } |
| \ No newline at end of file | ||
modified
results/tables/E1_core_primary.csv
+165 −165
@@ -1,165 +1,165 @@ | ||
| 1 | −family,pair,condition,method,access,n,n_docs,quality,q_lo,q_hi,success_rate,payload_bytes_median,cache_bytes_median,cold_ms_p50,warm_ms_p50,amortized_ms_p50,ttft_ms_p50,peak_decode_mem_median,fetched_bytes_mean | |
| 2 | −exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A0,A0,none,40,40,0.0,0.0,0.0,1.0,0.0,,1258.4582085255533,1258.450958528556,1258.4582085255533,11.510187992826104,6547584464.0,0.0 | |
| 3 | −exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A1,A1,none,40,40,0.95,0.875,1.0,1.0,7817.0,,1986.9115210021846,1986.9039590121247,1986.9115210021846,12.162082944996655,7123374444.0,0.0 | |
| 4 | −exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A2|budget_tokens=512,A2,none,40,40,0.7,0.55,0.85,1.0,2158.5,,1410.8660004567355,1409.1922294464894,1410.8660004567355,11.836166551802307,6810762776.0,0.0 | |
| 5 | −exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A3|budget_tokens=512|aware,A3,aware,40,40,0.2,0.075,0.325,1.0,2349.0,,1423.6712495330721,1422.393708024174,1423.6712495330721,11.827166483271867,6805962264.0,0.0 | |
| 6 | −exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A3|budget_tokens=512|blind,A3,blind,40,40,0.975,0.925,1.0,1.0,1560.0,,1329.3726665433496,1327.518479025457,1329.3726665433496,11.832229502033442,6801636888.0,0.0 | |
| 7 | −exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A4|budget_tokens=512|blind,A4,blind,40,40,0.825,0.7,0.925,1.0,1664.0,,8203.995228977874,1488.7063130154274,8203.995228977874,11.814270517788827,6840548888.0,0.0 | |
| 8 | −exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A5|budget_tokens=512|blind,A5,blind,40,40,0.0,0.0,0.0,1.0,1245.5,,8283.329896512441,1541.5113129420206,8283.329896512441,11.789770913310349,6766525528.0,0.0 | |
| 9 | −exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,40,40,0.15,0.05,0.275,1.0,280.0,,1566.0093335900456,1565.9761460265145,1566.0093335900456,11.801395448856056,6751091800.0,938.575 | |
| 10 | −exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A7|codec=zstd,A7,none,40,40,0.95,0.875,1.0,1.0,1304.5,,1995.8721044822596,1995.802208490204,1995.8721044822596,12.078374973498285,7123374444.0,0.0 | |
| 11 | −exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A8|budget_tokens=512|blind,A8,blind,40,40,0.0,0.0,0.0,0.0,,,0.0,0.0,0.0,,,0.0 | |
| 12 | −exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B0,B0,blind,40,40,0.95,0.875,1.0,1.0,209433294.0,209420288.0,2161.7709995480254,1476.9027290167287,2161.7709995480254,51.358687051106244,7181169892.0,0.0 | |
| 13 | −exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B1,B1,blind,40,40,0.95,0.875,1.0,1.0,209433322.0,209420288.0,2183.0639789113775,1496.8550420016982,2183.0639789113775,49.82733295764774,7180973284.0,0.0 | |
| 14 | −exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B2|bits=4,B2,blind,40,40,1.0,1.0,1.0,1.0,58926513.0,58899456.0,2119.401790900156,1451.94422948407,2119.401790900156,42.334249475970864,6889044124.0,0.0 | |
| 15 | −exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B2|bits=8,B2,blind,40,40,0.975,0.925,1.0,1.0,111281646.0,111254528.0,2210.5782500002533,1535.811958485283,2210.5782500002533,46.82985402178019,6988483448.0,0.0 | |
| 16 | −exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B3|keep_frac=0.25,B3,blind,40,40,0.0,0.0,0.0,1.0,52310610.5,52297728.0,1860.3221669909544,1205.5079169222154,1860.3221669909544,38.808708486612886,6849066220.0,0.0 | |
| 17 | −exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B4|keep_frac=0.25,B4,blind,40,40,0.0,0.0,0.0,1.0,52310605.5,52297728.0,4451.304083515424,3796.235208399594,4451.304083515424,38.95141644170508,6849033452.0,0.0 | |
| 18 | −exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B5|keep_frac=0.25|aware,B5,aware,40,40,0.0,0.0,0.0,1.0,52310650.0,52297728.0,1806.6551666124724,1050.931437057443,1806.6551666124724,38.52089599240571,6849033452.0,0.0 | |
| 19 | −exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B5|keep_frac=0.25|blind,B5,blind,40,40,0.0,0.0,0.0,1.0,52310650.5,52297728.0,3011.4672069321387,2129.6908954391256,3011.4672069321387,38.901541964150965,6849033452.0,0.0 | |
| 20 | −exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B6|keep_frac=0.25|aware,B6,aware,40,40,0.0,0.0,0.0,1.0,52310620.5,52297728.0,2778.506062924862,2027.1265839692205,2778.506062924862,334.88885447150096,6845531164.0,0.0 | |
| 21 | −exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,40,40,0.0,0.0,0.0,1.0,27809951.5,27783168.0,1970.285561925266,1212.8924999851733,1970.285561925266,38.66083355387673,6801847812.0,0.0 | |
| 22 | −exec,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A0,A0,none,40,40,0.0,0.0,0.0,1.0,0.0,,50.99683249136433,50.98568700486794,50.99683249136433,13.265458575915545,6245933480.0,0.0 | |
| 23 | −exec,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A1,A1,none,40,40,1.0,1.0,1.0,1.0,7817.0,,1616.299791377969,1616.291937418282,1616.299791377969,13.873937481548637,7018315388.0,0.0 | |
| 24 | −exec,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A2|budget_tokens=512,A2,none,40,40,1.0,1.0,1.0,1.0,2063.0,,1380.298041505739,1378.6934584495611,1380.298041505739,13.52102094097063,6569209944.0,0.0 | |
| 25 | −exec,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A3|budget_tokens=512|aware,A3,aware,40,40,0.5,0.35,0.65,1.0,2308.5,,1505.1244788919576,1503.8990624598227,1505.1244788919576,13.473541475832462,6562050136.0,0.0 | |
| 26 | −exec,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A3|budget_tokens=512|blind,A3,blind,40,40,1.0,1.0,1.0,1.0,1459.0,,1277.185709157493,1275.6410425063223,1277.185709157493,13.463333540130407,6563229784.0,0.0 | |
| 27 | −exec,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A4|budget_tokens=512|blind,A4,blind,40,40,0.375,0.225,0.525,1.0,1329.0,,6299.70408254303,1357.3949374840595,6299.70408254303,13.420354051049799,6489106190.0,0.0 | |
| 28 | −exec,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A5|budget_tokens=512|blind,A5,blind,40,40,0.125,0.025,0.225,1.0,938.0,,6534.907438093796,1300.7948960876092,6534.907438093796,13.370978937018663,6482995136.0,0.0 | |
| 29 | −exec,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,40,40,0.225,0.1,0.35,1.0,340.0,,1280.8366029639728,1280.813749472145,1280.8366029639728,13.503895956091583,6565030904.0,958.725 | |
| 30 | −exec,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A7|codec=zstd,A7,none,40,40,1.0,1.0,1.0,1.0,1304.5,,1614.060938009061,1613.9931670040824,1614.060938009061,13.793000020086765,7018315388.0,0.0 | |
| 31 | −exec,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A8|budget_tokens=512|blind,A8,blind,40,40,0.0,0.0,0.0,1.0,2257.5,,299.0590829285793,104.2349580093287,299.0590829285793,13.515916944015771,6612414552.0,0.0 | |
| 32 | −exec,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B0,B0,blind,40,40,1.0,1.0,1.0,1.0,69762760.0,69746688.0,1671.5779785299674,1454.5991040067747,1671.5779785299674,26.289125031325966,6443884896.0,0.0 | |
| 33 | −exec,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B1,B1,blind,40,40,1.0,1.0,1.0,1.0,69762788.0,69746688.0,1678.0685833655298,1461.9321874342859,1678.0685833655298,26.193187979515642,6443491568.0,0.0 | |
| 34 | −exec,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B2|bits=4,B2,blind,40,40,0.0,0.0,0.0,0.825,19650296.0,19616256.0,3499.5465414831415,3281.653458427172,3499.5465414831415,20.649228943511844,6353736674.0,0.0 | |
| 35 | −exec,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B2|bits=8,B2,blind,40,40,1.0,1.0,1.0,1.0,37087110.0,37052928.0,1748.5522304777987,1527.8222084743902,1748.5522304777987,20.812437462154776,6391963660.0,0.0 | |
| 36 | −exec,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B3|keep_frac=0.25,B3,blind,40,40,0.0,0.0,0.0,1.0,17452581.0,17436672.0,956.3981250976212,740.5964171048254,956.3981250976212,18.599771021399647,6328893680.0,0.0 | |
| 37 | −exec,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B4|keep_frac=0.25,B4,blind,40,40,0.0,0.0,0.0,0.925,17452576.0,17436672.0,4534.33343739016,4322.83162540989,4534.33343739016,18.42766656773165,6328885488.0,0.0 | |
| 38 | −exec,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B5|keep_frac=0.25|aware,B5,aware,40,40,0.0,0.0,0.0,1.0,17452621.0,17436672.0,1546.2896669632755,1297.9612504132092,1546.2896669632755,18.14260403625667,6328705264.0,0.0 | |
| 39 | −exec,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B5|keep_frac=0.25|blind,B5,blind,40,40,0.0,0.0,0.0,1.0,17452621.0,17436672.0,1404.5618129894137,1157.1117919520475,1404.5618129894137,18.43020849628374,6328705264.0,0.0 | |
| 40 | −exec,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B6|keep_frac=0.25|aware,B6,aware,40,40,0.0,0.0,0.0,1.0,17452580.0,17436672.0,1730.0592699903063,1481.2797500635497,1730.0592699903063,417.85912500927225,6313638200.0,0.0 | |
| 41 | −exec,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,40,40,0.0,0.0,0.0,1.0,9296753.0,9263232.0,1668.3023320510983,1411.4823329728097,1668.3023320510983,17.84149999730289,6317180536.0,0.0 | |
| 42 | −public_2wikimqa,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A0,A0,none,40,40,0.0625,0.0,0.1375,1.0,0.0,,61.31758342962712,61.30829197354615,61.31758342962712,13.563938031438738,6515504582.0,0.0 | |
| 43 | −public_2wikimqa,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A1,A1,none,40,40,0.3302579365079365,0.19761160714285717,0.4666666666666666,1.0,26477.0,,838.0565835395828,838.0487085087225,838.0565835395828,15.187958488240838,7614567478.0,0.0 | |
| 44 | −public_2wikimqa,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A2|budget_tokens=512,A2,none,40,40,0.07291666666666666,0.00625,0.15416666666666665,1.0,2053.5,,110.34681159071624,105.7645000400953,110.34681159071624,13.786938041448593,6870195718.0,0.0 | |
| 45 | −public_2wikimqa,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A3|budget_tokens=512|aware,A3,aware,40,40,0.16464285714285715,0.07177678571428574,0.27214285714285713,1.0,2089.0,,120.70233299164101,118.07974940165877,120.70233299164101,13.71116645168513,6860832264.0,0.0 | |
| 46 | −public_2wikimqa,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A3|budget_tokens=512|blind,A3,blind,40,40,0.034999999999999996,0.0,0.1,1.0,1924.0,,117.97743756324053,104.87143753562123,117.97743756324053,13.734270993154496,6862609914.0,0.0 | |
| 47 | −public_2wikimqa,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A4|budget_tokens=512|blind,A4,blind,40,40,0.16297619047619047,0.06583333333333334,0.26882142857142854,1.0,2038.5,,8716.081208491232,107.33179206727073,8716.081208491232,13.712061976548284,6870957596.0,0.0 | |
| 48 | −public_2wikimqa,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A5|budget_tokens=512|blind,A5,blind,40,40,0.058333333333333334,0.0,0.13333333333333336,1.0,1099.0,,8670.968083490152,84.7092714975588,8670.968083490152,13.663416961207986,6747823192.0,0.0 | |
| 49 | −public_2wikimqa,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,40,40,0.09880952380952382,0.023809523809523808,0.19166666666666665,1.0,389.0,,104.96470803627744,104.93379150284454,104.96470803627744,13.659229502081871,6842465788.0,923.775 | |
| 50 | −public_2wikimqa,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A7|codec=zstd,A7,none,40,40,0.3302579365079365,0.19761160714285717,0.4666666666666666,1.0,10766.5,,847.1706879790872,847.0414169714786,847.1706879790872,15.424749522935599,7614567478.0,0.0 | |
| 51 | −public_2wikimqa,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A8|budget_tokens=512|blind,A8,blind,40,40,0.075,0.0,0.175,1.0,1816.5,,961.6785630350932,121.2931249756366,961.6785630350932,13.804020476527512,6904430324.0,0.0 | |
| 52 | −public_2wikimqa,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B0,B0,blind,40,40,0.3302579365079365,0.19761160714285717,0.4666666666666666,1.0,744108792.0,744095744.0,1022.4113956210203,110.78031297074631,1022.4113956210203,42.49874997185543,8844096712.0,0.0 | |
| 53 | −public_2wikimqa,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B1,B1,blind,40,40,0.3302579365079365,0.19761160714285717,0.4666666666666666,1.0,744108820.0,744095744.0,1078.9334585424513,177.0352924359031,1078.9334585424513,41.77858354523778,8844096712.0,0.0 | |
| 54 | −public_2wikimqa,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B2|bits=4,B2,blind,40,40,0.21666666666666665,0.10416666666666666,0.3416666666666667,1.0,209304201.0,209276928.0,917.6457915455103,87.52035396173596,917.6457915455103,28.353708039503545,7763563872.0,0.0 | |
| 55 | −public_2wikimqa,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B2|bits=8,B2,blind,40,40,0.3302579365079365,0.19761160714285717,0.4666666666666666,1.0,395328218.0,395300864.0,951.9116040901281,87.27945800637826,951.9116040901281,29.329562501516193,8176473440.0,0.0 | |
| 56 | −public_2wikimqa,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B3|keep_frac=0.25,B3,blind,40,40,0.32400793650793647,0.19205357142857146,0.45912698412698416,1.0,186037056.0,186023936.0,911.9993314961903,91.53133415384218,911.9993314961903,23.624812019988894,7610430656.0,0.0 | |
| 57 | −public_2wikimqa,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B4|keep_frac=0.25,B4,blind,40,40,0.0,0.0,0.0,0.825,186037051.0,186023936.0,1403.2247085124254,712.2888540616259,1403.2247085124254,23.287000018171966,7610430656.0,0.0 | |
| 58 | −public_2wikimqa,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B5|keep_frac=0.25|aware,B5,aware,40,40,0.32089285714285715,0.1875,0.4596651785714284,1.0,186037096.0,186023936.0,990.1295835734345,69.1054585040547,990.1295835734345,22.277812531683594,7610430656.0,0.0 | |
| 59 | −public_2wikimqa,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B5|keep_frac=0.25|blind,B5,blind,40,40,0.2838888888888889,0.15888194444444448,0.42056249999999995,1.0,186037096.0,186023936.0,959.1962915146723,64.08647989155725,959.1962915146723,22.64814602676779,7610430656.0,0.0 | |
| 60 | −public_2wikimqa,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B6|keep_frac=0.25|aware,B6,aware,40,40,0.29375,0.15625,0.4375,1.0,186037011.0,186023936.0,1427.9097704566084,526.5463123796508,1427.9097704566084,493.36456251330674,7803809312.0,0.0 | |
| 61 | −public_2wikimqa,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,40,40,0.32089285714285715,0.1875,0.4596651785714284,1.0,98852491.0,98825216.0,976.0725206579082,70.43647894170135,976.0725206579082,19.95449955575168,7458923884.0,0.0 | |
| 62 | −public_2wikimqa,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A0,A0,none,40,40,0.1125,0.0375,0.2125,1.0,0.0,,59.17302001034841,59.158478514291346,59.17302001034841,13.196521031204611,6241993108.0,0.0 | |
| 63 | −public_2wikimqa,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A1,A1,none,40,40,0.3875,0.25,0.5375,1.0,26477.0,,862.7995005808771,862.7924170577899,862.7995005808771,14.084312540944666,7239368768.0,0.0 | |
| 64 | −public_2wikimqa,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A2|budget_tokens=512,A2,none,40,40,0.11666666666666665,0.025,0.225,1.0,1973.0,,106.45749949617311,97.87616651738063,106.45749949617311,13.45000002766028,6568923224.0,0.0 | |
| 65 | −public_2wikimqa,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A3|budget_tokens=512|aware,A3,aware,40,40,0.21291666666666664,0.11041666666666665,0.3300312499999998,1.0,1940.5,,113.71260363375768,110.9033121028915,113.71260363375768,13.465750496834517,6559346776.0,0.0 | |
| 66 | −public_2wikimqa,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A3|budget_tokens=512|blind,A3,blind,40,40,0.1125,0.025,0.2125,1.0,1735.0,,114.57770806737244,96.89510404132307,114.57770806737244,13.402666547335684,6562443352.0,0.0 | |
| 67 | −public_2wikimqa,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A4|budget_tokens=512|blind,A4,blind,40,40,0.20347222222222222,0.09791666666666667,0.3208506944444443,1.0,1749.5,,8053.586145979352,97.53939497750252,8053.586145979352,13.36843753233552,6583652440.0,0.0 | |
| 68 | −public_2wikimqa,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A5|budget_tokens=512|blind,A5,blind,40,40,0.12333333333333334,0.04,0.23166666666666663,1.0,810.0,,7940.129436494317,80.12141706421971,7940.129436494317,13.376353948842734,6494488374.0,0.0 | |
| 69 | −public_2wikimqa,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,40,40,0.11000000000000001,0.025,0.22000000000000003,1.0,466.5,,126.47829105844721,126.43012392800301,126.47829105844721,13.430749473627657,6640562264.0,1217.275 | |
| 70 | −public_2wikimqa,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A7|codec=zstd,A7,none,40,40,0.3875,0.25,0.5375,1.0,10766.5,,986.8479584692977,986.7087295278907,986.8479584692977,14.408541494049132,7239368768.0,0.0 | |
| 71 | −public_2wikimqa,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A8|budget_tokens=512|blind,A8,blind,40,40,0.0625,0.0,0.1375,1.0,1721.5,,667.4353124690242,109.33960444526747,667.4353124690242,13.598332996480167,6599094360.0,0.0 | |
| 72 | −public_2wikimqa,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B0,B0,blind,40,40,0.3625,0.225,0.5041666666666667,1.0,254580530.0,254564352.0,1078.0544368899427,123.88258392456919,1078.0544368899427,58.98822902236134,7024730428.0,0.0 | |
| 73 | −public_2wikimqa,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B1,B1,blind,40,40,0.3625,0.225,0.5041666666666667,1.0,254580558.0,254564352.0,1081.1359789804555,142.88037497317418,1081.1359789804555,54.69964555231854,7024730316.0,0.0 | |
| 74 | −public_2wikimqa,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B2|bits=4,B2,blind,40,40,0.003913630229419702,0.0,0.010458839406207825,0.975,71630478.0,71596224.0,1630.7963539729826,739.3143955268897,1630.7963539729826,29.354833532124758,6681390136.0,0.0 | |
| 75 | −public_2wikimqa,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B2|bits=8,B2,blind,40,40,0.3625,0.225,0.5041666666666667,1.0,135271688.0,135237312.0,1035.3826249483973,97.3766659735702,1035.3826249483973,30.708041042089462,6821831068.5,0.0 | |
| 76 | −public_2wikimqa,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B3|keep_frac=0.25,B3,blind,40,40,0.39464285714285713,0.25416666666666665,0.5488392857142856,1.0,63661888.0,63645696.0,1020.8498335559852,81.72633306821808,1020.8498335559852,24.91972898133099,6605316300.0,0.0 | |
| 77 | −public_2wikimqa,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B4|keep_frac=0.25,B4,blind,40,40,0.008613445378151261,0.0,0.024369747899159667,0.925,63661883.0,63645696.0,1539.1613344545476,676.473917614203,1539.1613344545476,24.953124986495823,6605316300.0,0.0 | |
| 78 | −public_2wikimqa,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B5|keep_frac=0.25|aware,B5,aware,40,40,0.3392857142857143,0.2,0.4833333333333333,1.0,63661928.0,63645696.0,1062.0520829688758,82.09260407602414,1062.0520829688758,24.084812554065138,6605316300.0,0.0 | |
| 79 | −public_2wikimqa,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B5|keep_frac=0.25|blind,B5,blind,40,40,0.30625,0.175,0.45,1.0,63661928.0,63645696.0,1037.0062295696698,79.50931205414236,1037.0062295696698,24.317916948348284,6605316300.0,0.0 | |
| 80 | −public_2wikimqa,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B6|keep_frac=0.25|aware,B6,aware,40,40,0.36428571428571427,0.228482142857143,0.5083630952380951,1.0,63661830.0,63645696.0,1445.9590209880844,466.9628744595684,1445.9590209880844,398.6886665225029,6655922112.0,0.0 | |
| 81 | −public_2wikimqa,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,40,40,0.35178571428571426,0.21845238095238093,0.4916666666666666,1.0,33846113.5,33811776.0,1065.1935209752992,79.09508352167904,1065.1935209752992,19.883000059053302,6554773592.0,0.0 | |
| 82 | −public_qasper,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A0,A0,none,40,40,0.053520674727571285,0.00762987012987013,0.11977830646365119,1.0,0.0,,65.9553125151433,65.94904151279479,65.9553125151433,13.496875006239861,6510474664.0,0.0 | |
| 83 | −public_qasper,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A1,A1,none,40,40,0.2537783280350416,0.15373085330146563,0.36433162174894096,1.0,24485.5,,727.1668530884199,727.1603115950711,727.1668530884199,14.904125011526048,7465718848.0,0.0 | |
| 84 | −public_qasper,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A2|budget_tokens=512,A2,none,40,40,0.06596767217456873,0.02368412239101894,0.1264588058014782,1.0,2645.0,,129.87125013023615,127.00175010832027,129.87125013023615,13.727125013247132,6865649128.0,0.0 | |
| 85 | −public_qasper,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A3|budget_tokens=512|aware,A3,aware,40,40,0.23695446852096466,0.14541538242944893,0.3455378195824967,1.0,2503.5,,158.11447944724932,156.55895846430212,158.11447944724932,13.684041507076472,6856752608.0,0.0 | |
| 86 | −public_qasper,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A3|budget_tokens=512|blind,A3,blind,40,40,0.14415518358453142,0.06653808284107197,0.22890076522209668,1.0,2108.5,,149.97426996706054,143.4077289304696,149.97426996706054,13.658125011716038,6859865572.0,0.0 | |
| 87 | −public_qasper,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A4|budget_tokens=512|blind,A4,blind,40,40,0.19959273932500582,0.10820102144256978,0.30105128414152005,1.0,2603.0,,8184.926540940069,143.69518699822947,8184.926540940069,13.65083345444873,6863125988.0,0.0 | |
| 88 | −public_qasper,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A5|budget_tokens=512|blind,A5,blind,40,40,0.05102564102564102,0.008333333333333333,0.11103311965811961,1.0,968.0,,8221.8351039337,81.11052104504779,8221.8351039337,13.581979554146528,6697516120.0,0.0 | |
| 89 | −public_qasper,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,40,40,0.0661431623931624,0.015382211538461544,0.13314583333333332,1.0,431.0,,111.73445841995999,111.69662489555776,111.73445841995999,13.675124966539443,6877355576.0,1288.45 | |
| 90 | −public_qasper,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A7|codec=zstd,A7,none,40,40,0.2537783280350416,0.15373085330146563,0.36433162174894096,1.0,9070.5,,785.8203329960816,785.5639375047758,785.8203329960816,15.055291471071541,7465718848.0,0.0 | |
| 91 | −public_qasper,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A8|budget_tokens=512|blind,A8,blind,40,40,0.22771284244269147,0.1316498298861027,0.33295768298472694,1.0,2545.5,,770.1807499979623,150.92641697265208,770.1807499979623,13.779875007458031,6907231900.0,0.0 | |
| 92 | −public_qasper,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B0,B0,blind,40,40,0.2537783280350416,0.15373085330146563,0.36433162174894096,1.0,578040564.0,578027520.0,966.9294175691903,141.73779159318656,966.9294175691903,38.254000479355454,8312747188.0,0.0 | |
| 93 | −public_qasper,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B1,B1,blind,40,40,0.2537783280350416,0.15373085330146563,0.36433162174894096,1.0,578040592.0,578027520.0,1006.8175835185684,191.32306252140552,1006.8175835185684,36.52475000126287,8312747188.0,0.0 | |
| 94 | −public_qasper,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B2|bits=4,B2,blind,40,40,0.25432579117832765,0.153750429395278,0.363530122247789,1.0,162597464.0,162570240.0,875.7963750394993,123.03260347107425,875.7963750394993,24.27243796410039,7439708640.0,0.0 | |
| 95 | −public_qasper,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B2|bits=8,B2,blind,40,40,0.2537783280350416,0.15373085330146563,0.36433162174894096,1.0,307104450.0,307077120.0,923.8226665765978,128.16997891059145,923.8226665765978,25.769770552869886,7759564508.0,0.0 | |
| 96 | −public_qasper,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B3|keep_frac=0.25,B3,blind,40,40,0.16082072722300209,0.08518288294532156,0.2510588201241594,1.0,144519982.5,144506880.0,827.808978559915,88.17443740554154,827.808978559915,21.28720801556483,7362794676.0,0.0 | |
| 97 | −public_qasper,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B4|keep_frac=0.25,B4,blind,40,40,0.07447303921568628,0.011764705882352943,0.159375,0.85,144519977.0,144506880.0,1270.7714784191921,697.6080205058679,1270.7714784191921,20.92524996260181,7362794676.0,0.0 | |
| 98 | −public_qasper,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B5|keep_frac=0.25|aware,B5,aware,40,40,0.24277583985218615,0.151606606366538,0.34430225224520655,1.0,144520021.0,144506880.0,904.3003126280382,109.62083359481767,904.3003126280382,20.468145434278995,7362794676.0,0.0 | |
| 99 | −public_qasper,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B5|keep_frac=0.25|blind,B5,blind,40,40,0.1870317755238296,0.09726531188192125,0.28550238619193186,1.0,144520022.0,144506880.0,885.7176880119368,82.61193748330697,885.7176880119368,20.840229000896215,7362794676.0,0.0 | |
| 100 | −public_qasper,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B6|keep_frac=0.25|aware,B6,aware,40,40,0.243191089563836,0.1529984118743194,0.34138962849027604,1.0,144519925.0,144506880.0,1196.1688324809074,467.6350621157326,1196.1688324809074,337.63170801103115,7496383140.0,0.0 | |
| 101 | −public_qasper,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,40,40,0.23538707665459943,0.1437460416846976,0.33762197165669905,1.0,76796546.0,76769280.0,894.2440829705447,95.0739789986983,894.2440829705447,19.250125042162836,7227740640.0,0.0 | |
| 102 | −public_qasper,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A0,A0,none,40,40,0.04142585580594076,0.007637997532383382,0.09814090546216682,1.0,0.0,,46.06579209212214,46.056688064709306,46.06579209212214,13.382770994212478,6219424104.0,0.0 | |
| 103 | −public_qasper,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A1,A1,none,40,40,0.3524582923320977,0.23883181230104608,0.47279664560678997,1.0,24485.5,,745.9065829752944,745.8995829802006,745.9065829752944,14.21087549533695,7155474496.0,0.0 | |
| 104 | −public_qasper,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A2|budget_tokens=512,A2,none,40,40,0.0878869286287089,0.028754152823920263,0.16423767995570318,1.0,2601.5,,108.99041715310887,103.18029159680009,108.99041715310887,13.605854008346796,6564311128.0,0.0 | |
| 105 | −public_qasper,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A3|budget_tokens=512|aware,A3,aware,40,40,0.20037559549133369,0.11038688582962186,0.29392695953636033,1.0,2489.0,,121.99314642930403,120.10777142131701,121.99314642930403,13.487062067724764,6556938328.0,0.0 | |
| 106 | −public_qasper,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A3|budget_tokens=512|blind,A3,blind,40,40,0.17671057593077716,0.08363678728070176,0.28627020446336426,1.0,1921.5,,125.1891881111078,115.41158257750794,125.1891881111078,13.500208500772715,6557331544.0,0.0 | |
| 107 | −public_qasper,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A4|budget_tokens=512|blind,A4,blind,40,40,0.1712858923966609,0.08545177548376676,0.27294349495381276,1.0,1576.5,,5029.291937593371,83.08352145832032,5029.291937593371,13.349354558158666,6488081952.0,0.0 | |
| 108 | −public_qasper,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A5|budget_tokens=512|blind,A5,blind,40,40,0.09325396825396826,0.025,0.18214285714285713,1.0,864.5,,7716.917958576232,75.53093699971214,7716.917958576232,13.376458489801735,6465111492.0,0.0 | |
| 109 | −public_qasper,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,40,40,0.0916328761677599,0.024966209501093222,0.17325129198966407,1.0,402.0,,102.26277098990977,102.22927096765488,102.26277098990977,13.375187467318028,6580244568.0,1275.675 | |
| 110 | −public_qasper,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A7|codec=zstd,A7,none,40,40,0.3524582923320977,0.23883181230104608,0.47279664560678997,1.0,9070.5,,764.1158540500328,763.9933960163034,764.1158540500328,14.18656250461936,7155474496.0,0.0 | |
| 111 | −public_qasper,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A8|budget_tokens=512|blind,A8,blind,40,40,0.1703928482427472,0.095372260168256,0.2543030919048409,1.0,2485.5,,584.9466664367355,130.6202500127256,584.9466664367355,13.61447898671031,6607204440.0,0.0 | |
| 112 | −public_qasper,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B0,B0,blind,40,40,0.352023064477515,0.2383965844464634,0.4719260368517915,1.0,189331228.0,189315072.0,868.3839794830419,136.56529149739072,868.3839794830419,45.000125479418784,6814936304.0,0.0 | |
| 113 | −public_qasper,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B1,B1,blind,40,40,0.352023064477515,0.2383965844464634,0.4719260368517915,1.0,189331256.0,189315072.0,887.9102920764126,149.75345897255465,887.9102920764126,42.2816455247812,6814936248.0,0.0 | |
| 114 | −public_qasper,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B2|bits=4,B2,blind,40,40,0.006331743508214097,0.0,0.015313487016428186,0.85,53279094.0,53244864.0,1377.5208949227817,727.0087914657779,1377.5208949227817,23.64412450697273,6560093950.5,0.0 | |
| 115 | −public_qasper,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B2|bits=8,B2,blind,40,40,0.37503821241201774,0.2544268509119095,0.503267557517078,1.0,100607913.0,100573632.0,852.9593333369121,107.36995853949338,852.9593333369121,24.1553335217759,6662213424.0,0.0 | |
| 116 | −public_qasper,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B3|keep_frac=0.25,B3,blind,40,40,0.18833570671908945,0.09931079256446874,0.29042796386027525,1.0,47349560.0,47333376.0,816.352813562844,73.56977043673396,816.352813562844,22.071291517931968,6504754360.0,0.0 | |
| 117 | −public_qasper,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B4|keep_frac=0.25,B4,blind,40,40,0.06238475229321912,0.015609953325342348,0.13097708649410586,0.9,47349555.0,47333376.0,1191.2303749704733,497.9330000351183,1191.2303749704733,22.010812477674335,6504754360.0,0.0 | |
| 118 | −public_qasper,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B5|keep_frac=0.25|aware,B5,aware,40,40,0.2865065059897759,0.18546910413002085,0.40048248270099884,1.0,47349600.0,47333376.0,856.4752705860883,91.3222705712542,856.4752705860883,21.61108300788328,6504328376.0,0.0 | |
| 119 | −public_qasper,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B5|keep_frac=0.25|blind,B5,blind,40,40,0.20624202311879092,0.1117775040316477,0.3167712243764782,1.0,47349600.0,47333376.0,849.5922079309821,62.9603749839589,849.5922079309821,21.98331250110641,6504328376.0,0.0 | |
| 120 | −public_qasper,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B6|keep_frac=0.25|aware,B6,aware,40,40,0.2652581506721279,0.16187616797075396,0.38009561979821493,1.0,47349474.0,47333376.0,1156.025978445541,388.32566648488864,1156.025978445541,306.9419994717464,6541476740.0,0.0 | |
| 121 | −public_qasper,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,40,40,0.2844661026716981,0.18117210682811177,0.4016838943872298,1.0,25180151.5,25145856.0,865.985604992602,93.56572898104787,865.985604992602,19.180521019734442,6464650960.0,0.0 | |
| 122 | −synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A0,A0,none,200,40,0.0,0.0,0.0,1.0,0.0,,157.36941754585132,157.36408397788182,157.36515069147572,23.465062549803406,6555547060.0,0.0 | |
| 123 | −synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A1,A1,none,200,40,0.99,0.975,1.0,1.0,29207.5,,2861.687187454663,2861.679062480107,2861.680687475018,27.46989601291716,7576794164.0,0.0 | |
| 124 | −synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A2|budget_tokens=512,A2,none,200,40,0.205,0.17,0.24,1.0,2347.0,,405.87554196827114,402.4369170074351,402.91585446102545,26.229520968627185,6810402320.0,0.0 | |
| 125 | −synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A3|budget_tokens=512|aware,A3,aware,200,40,0.995,0.985,1.0,1.0,1604.5,,532.9524165135808,530.521520995535,532.9524165135808,24.227604502812028,6806912504.0,0.0 | |
| 126 | −synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A3|budget_tokens=512|blind,A3,blind,200,40,0.405,0.4,0.415,1.0,1563.5,,444.42235393216833,436.8094165693037,438.5126998764463,24.473979545291513,6803176952.0,0.0 | |
| 127 | −synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A4|budget_tokens=512|aware,A4,aware,120,40,0.8333333333333334,0.7666666666666667,0.9,1.0,1509.0,,18769.84793745214,520.637666573748,18769.84793745214,25.514833512715995,6817431036.0,0.0 | |
| 128 | −synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A4|budget_tokens=512|blind,A4,blind,200,40,0.44,0.385,0.495,1.0,1838.5,,18976.632187899668,444.4485829444602,4166.054411872756,25.369146023876965,6817431036.0,0.0 | |
| 129 | −synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A5|budget_tokens=512|aware,A5,aware,120,40,0.95,0.9083333333333333,0.9833333333333333,1.0,233.5,,8669.620249595027,422.92658297810704,8669.620249595027,26.59820852568373,6607812288.0,0.0 | |
| 130 | −synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A5|budget_tokens=512|blind,A5,blind,200,40,0.125,0.09,0.155,1.0,842.0,,18998.95481200656,344.1750835045241,4091.6990083642304,23.827395518310368,6734748760.0,0.0 | |
| 131 | −synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,200,40,0.175,0.135,0.215,1.0,707.0,,492.9024174925871,492.8722715121694,492.87830070825294,25.794854445848614,6933195852.0,1367.27 | |
| 132 | −synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A7|codec=zstd,A7,none,200,40,0.99,0.975,1.0,1.0,2726.0,,2857.3816449497826,2857.2952494141646,2857.312528521288,27.074062498286366,7576794164.0,0.0 | |
| 133 | −synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A8|budget_tokens=512|blind,A8,blind,200,40,0.0,0.0,0.0,0.0,,,0.0,0.0,0.0,,,0.0 | |
| 134 | −synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B0,B0,blind,200,40,0.99,0.975,1.0,1.0,651268854.0,651255808.0,3253.5364581272006,393.2519589434378,973.5832870006561,136.40537502942607,8593077474.0,0.0 | |
| 135 | −synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B1,B1,blind,200,40,0.99,0.975,1.0,1.0,651268882.0,651255808.0,3351.503874640912,505.0313540850766,1057.6043623499572,144.29387502605096,8593069282.0,0.0 | |
| 136 | −synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B2|bits=4,B2,blind,200,40,0.975,0.945,0.995,1.0,183192937.0,183165696.0,3111.2300624372438,335.1737505290657,882.7701129950583,106.28564545186237,7628087269.0,0.0 | |
| 137 | −synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B2|bits=8,B2,blind,200,40,0.99,0.975,1.0,1.0,346006984.0,345979648.0,3146.7745005502366,358.00489655230194,916.1296371254139,108.4380624233745,7988651786.0,0.0 | |
| 138 | −synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B3|keep_frac=0.25,B3,blind,200,40,0.185,0.16,0.21,1.0,162812727.0,162799616.0,3009.2775429366156,277.9904584749602,822.304554330185,89.87866656389087,7514240212.0,0.0 | |
| 139 | −synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B4|keep_frac=0.25,B4,blind,200,40,0.0,0.0,0.0,0.96,162812721.5,162799616.0,4281.923291040584,1580.5572919198312,2123.8540127058513,89.75787495728582,7514240212.0,0.0 | |
| 140 | −synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B5|keep_frac=0.25|aware,B5,aware,200,40,0.985,0.965,1.0,1.0,162812766.0,162799616.0,3259.5277500804514,291.60412499913946,3259.5277500804514,91.043604479637,7514240212.0,0.0 | |
| 141 | −synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B5|keep_frac=0.25|blind,B5,blind,200,40,0.19,0.12,0.265,1.0,162812765.5,162799616.0,3129.6013329993,183.34420851897448,757.7406506170519,92.93381206225604,7514240212.0,0.0 | |
| 142 | −synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B6|keep_frac=0.25|aware,B6,aware,200,40,0.975,0.95,0.995,1.0,162812673.0,162799616.0,3922.836207493674,962.149562605191,3922.836207493674,749.9465415021405,7672888236.0,0.0 | |
| 143 | −synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,200,40,0.985,0.965,1.0,1.0,86514564.5,86487296.0,3211.8879585177638,287.61656302958727,3211.8879585177638,84.8972704843618,7378286352.0,0.0 | |
| 144 | −synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A0,A0,none,200,40,0.0,0.0,0.0,1.0,0.0,,50.41495896875858,50.405958958435804,50.40775896050036,13.265561952721328,6243951240.0,0.0 | |
| 145 | −synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A1,A1,none,200,40,0.99,0.975,1.0,1.0,29207.5,,950.7843535975553,950.7768115727231,950.7783199776895,14.600520953536034,7155474496.0,0.0 | |
| 146 | −synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A2|budget_tokens=512,A2,none,200,40,0.195,0.16,0.23,1.0,2237.5,,111.21093755355105,106.68506246292964,107.22286257660016,13.600957987364382,6567653464.0,0.0 | |
| 147 | −synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A3|budget_tokens=512|aware,A3,aware,200,40,0.97,0.945,0.99,1.0,1359.0,,208.21972895646468,205.5006460286677,208.21972895646468,13.554833538364619,6562443352.0,0.0 | |
| 148 | −synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A3|budget_tokens=512|blind,A3,blind,200,40,0.375,0.355,0.395,1.0,1243.0,,157.0329790120013,152.3254174971953,153.43078373698518,13.57818697579205,6562246744.0,0.0 | |
| 149 | −synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A4|budget_tokens=512|aware,A4,aware,120,40,0.9416666666666667,0.8916666666666667,0.9833333333333333,1.0,379.5,,3055.9733340051025,189.2200205475092,3055.9733340051025,13.356083014514297,6351775108.0,0.0 | |
| 150 | −synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A4|budget_tokens=512|blind,A4,blind,200,40,0.375,0.29,0.46,1.0,1424.5,,7449.7145840432495,127.20972893293947,1638.8054550508969,13.581104576587677,6567653464.0,0.0 | |
| 151 | −synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A5|budget_tokens=512|aware,A5,aware,120,40,1.0,1.0,1.0,1.0,118.0,,2137.8979585133493,178.15022950526327,2137.8979585133493,13.383313023950905,6300656332.0,0.0 | |
| 152 | −synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A5|budget_tokens=512|blind,A5,blind,200,40,0.15,0.12,0.175,1.0,827.0,,8156.952459132299,82.95993698993698,1699.9364422634244,13.478271022904664,6524249846.0,0.0 | |
| 153 | −synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,200,40,0.18,0.145,0.215,1.0,627.0,,169.26231351681054,169.23870902974159,169.24342992715538,13.843645516317338,6813358062.0,1490.29 | |
| 154 | −synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A7|codec=zstd,A7,none,200,40,0.99,0.975,1.0,1.0,2726.0,,1031.9313738727942,1031.8554784171283,1031.8706575082615,14.829437481239438,7155474496.0,0.0 | |
| 155 | −synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A8|budget_tokens=512|blind,A8,blind,200,40,0.135,0.09,0.185,1.0,2566.5,,1293.5829174821265,162.30137506499887,364.1857292270288,13.750895974226296,6603747416.0,0.0 | |
| 156 | −synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B0,B0,blind,200,40,0.99,0.975,1.0,1.0,215559973.0,215543808.0,1760.9770625131205,187.03570862999186,489.1586328856647,47.34012502012774,6902325564.0,0.0 | |
| 157 | −synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B1,B1,blind,200,40,0.99,0.975,1.0,1.0,215560001.0,215543808.0,1249.4945833459496,211.0927085741423,428.1928248470649,47.08545847097412,6902210788.0,0.0 | |
| 158 | −synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B2|bits=4,B2,blind,200,40,0.0,0.0,0.0,0.925,60655936.0,60621696.0,1706.1032095225528,737.6006674603559,957.3284577345476,28.023312508594245,6617885472.0,0.0 | |
| 159 | −synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B2|bits=8,B2,blind,200,40,0.99,0.975,1.0,1.0,114541977.0,114507648.0,1375.615374010522,174.04247901868075,427.2855912684463,31.199354503769428,6737391200.0,0.0 | |
| 160 | −synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B3|keep_frac=0.25,B3,blind,200,40,0.2,0.175,0.23,1.0,53892924.5,53876736.0,1106.2013980117626,122.37893755082041,344.84630380757153,24.08345852745697,6547349820.0,0.0 | |
| 161 | −synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B4|keep_frac=0.25,B4,blind,200,40,0.0,0.0,0.0,0.93,53892919.5,53876736.0,1658.0170001252554,676.7245414666831,892.330970952753,24.060583498794585,6547349820.0,0.0 | |
| 162 | −synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B5|keep_frac=0.25|aware,B5,aware,200,40,0.78,0.725,0.83,1.0,53892964.5,53876736.0,1236.3030216074549,136.36277109617367,1236.3030216074549,23.683937499299645,6546481380.0,0.0 | |
| 163 | −synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B5|keep_frac=0.25|blind,B5,blind,200,40,0.12,0.075,0.17,1.0,53892964.5,53876736.0,1218.1062293238938,101.19929199572653,340.085291385185,23.96877051796764,6546481380.0,0.0 | |
| 164 | −synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B6|keep_frac=0.25|aware,B6,aware,200,40,0.66,0.61,0.705,1.0,53892854.5,53876736.0,1639.2308954964392,539.650562859606,1639.2308954964392,414.88808300346136,6584983866.0,0.0 | |
| 165 | −synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,200,40,0.785,0.73,0.835,1.0,28656329.0,28622016.0,1268.601355026476,140.13310411246493,1268.601355026476,21.49270853260532,6506618028.0,0.0 | |
| 1 | +family,pair,condition,method,access,n,n_docs,quality,q_lo,q_hi,success_rate,payload_bytes_median,cache_bytes_median,cold_ms_p50,warm_ms_p50,amortized_ms_p50,ttft_ms_p50,peak_decode_mem_median,peak_cold_mem_median,fetched_bytes_mean | |
| 2 | +exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A0,A0,none,40,40,0.0,0.0,0.0,1.0,0.0,,1258.4582085255533,1258.450958528556,1258.4582085255533,11.510187992826104,6547584464.0,6547584464.0,0.0 | |
| 3 | +exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A1,A1,none,40,40,0.95,0.875,1.0,1.0,7817.0,,1986.9115210021846,1986.9039590121247,1986.9115210021846,12.162082944996655,7123374444.0,7123374444.0,0.0 | |
| 4 | +exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A2|budget_tokens=512,A2,none,40,40,0.7,0.55,0.85,1.0,2158.5,,1410.8660004567355,1409.1922294464894,1410.8660004567355,11.836166551802307,6810762776.0,6810762776.0,0.0 | |
| 5 | +exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A3|budget_tokens=512|aware,A3,aware,40,40,0.2,0.075,0.325,1.0,2349.0,,1423.6712495330721,1422.393708024174,1423.6712495330721,11.827166483271867,6805962264.0,6805962264.0,0.0 | |
| 6 | +exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A3|budget_tokens=512|blind,A3,blind,40,40,0.975,0.925,1.0,1.0,1560.0,,1329.3726665433496,1327.518479025457,1329.3726665433496,11.832229502033442,6801636888.0,6801636888.0,0.0 | |
| 7 | +exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A4|budget_tokens=512|blind,A4,blind,40,40,0.825,0.7,0.925,1.0,1664.0,,8203.995228977874,1488.7063130154274,8203.995228977874,11.814270517788827,6840548888.0,6840548888.0,0.0 | |
| 8 | +exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A5|budget_tokens=512|blind,A5,blind,40,40,0.0,0.0,0.0,1.0,1245.5,,8283.329896512441,1541.5113129420206,8283.329896512441,11.789770913310349,6766525528.0,6766525528.0,0.0 | |
| 9 | +exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,40,40,0.15,0.05,0.275,1.0,280.0,,1566.0093335900456,1565.9761460265145,1566.0093335900456,11.801395448856056,6751091800.0,6751091800.0,938.575 | |
| 10 | +exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A7|codec=zstd,A7,none,40,40,0.95,0.875,1.0,1.0,1304.5,,1995.8721044822596,1995.802208490204,1995.8721044822596,12.078374973498285,7123374444.0,7123374444.0,0.0 | |
| 11 | +exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A8|budget_tokens=512|blind,A8,blind,40,40,0.0,0.0,0.0,0.0,,,0.0,0.0,0.0,,,,0.0 | |
| 12 | +exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B0,B0,blind,40,40,0.95,0.875,1.0,1.0,209433294.0,209420288.0,2161.7709995480254,1476.9027290167287,2161.7709995480254,51.358687051106244,7181169892.0,7181169892.0,0.0 | |
| 13 | +exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B1,B1,blind,40,40,0.95,0.875,1.0,1.0,209433322.0,209420288.0,2183.0639789113775,1496.8550420016982,2183.0639789113775,49.82733295764774,7180973284.0,7180973284.0,0.0 | |
| 14 | +exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B2|bits=4,B2,blind,40,40,1.0,1.0,1.0,1.0,58926513.0,58899456.0,2119.401790900156,1451.94422948407,2119.401790900156,42.334249475970864,6889044124.0,7112184172.0,0.0 | |
| 15 | +exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B2|bits=8,B2,blind,40,40,0.975,0.925,1.0,1.0,111281646.0,111254528.0,2210.5782500002533,1535.811958485283,2210.5782500002533,46.82985402178019,6988483448.0,7112184172.0,0.0 | |
| 16 | +exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B3|keep_frac=0.25,B3,blind,40,40,0.0,0.0,0.0,1.0,52310610.5,52297728.0,1860.3221669909544,1205.5079169222154,1860.3221669909544,38.808708486612886,6849066220.0,7112184172.0,0.0 | |
| 17 | +exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B4|keep_frac=0.25,B4,blind,40,40,0.0,0.0,0.0,1.0,52310605.5,52297728.0,4451.304083515424,3796.235208399594,4451.304083515424,38.95141644170508,6849033452.0,7112184172.0,0.0 | |
| 18 | +exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B5|keep_frac=0.25|aware,B5,aware,40,40,0.0,0.0,0.0,1.0,52310650.0,52297728.0,1806.6551666124724,1050.931437057443,1806.6551666124724,38.52089599240571,6849033452.0,7112184172.0,0.0 | |
| 19 | +exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B5|keep_frac=0.25|blind,B5,blind,40,40,0.0,0.0,0.0,1.0,52310650.5,52297728.0,3011.4672069321387,2129.6908954391256,3011.4672069321387,38.901541964150965,6849033452.0,7112184172.0,0.0 | |
| 20 | +exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B6|keep_frac=0.25|aware,B6,aware,40,40,0.0,0.0,0.0,1.0,52310620.5,52297728.0,2778.506062924862,2027.1265839692205,2778.506062924862,334.88885447150096,6845531164.0,7112184172.0,0.0 | |
| 21 | +exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,40,40,0.0,0.0,0.0,1.0,27809951.5,27783168.0,1970.285561925266,1212.8924999851733,1970.285561925266,38.66083355387673,6801847812.0,7112184172.0,0.0 | |
| 22 | +exec,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A0,A0,none,40,40,0.0,0.0,0.0,1.0,0.0,,50.99683249136433,50.98568700486794,50.99683249136433,13.265458575915545,6245933480.0,6245933480.0,0.0 | |
| 23 | +exec,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A1,A1,none,40,40,1.0,1.0,1.0,1.0,7817.0,,1616.299791377969,1616.291937418282,1616.299791377969,13.873937481548637,7018315388.0,7018315388.0,0.0 | |
| 24 | +exec,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A2|budget_tokens=512,A2,none,40,40,1.0,1.0,1.0,1.0,2063.0,,1380.298041505739,1378.6934584495611,1380.298041505739,13.52102094097063,6569209944.0,6569209944.0,0.0 | |
| 25 | +exec,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A3|budget_tokens=512|aware,A3,aware,40,40,0.5,0.35,0.65,1.0,2308.5,,1505.1244788919576,1503.8990624598227,1505.1244788919576,13.473541475832462,6562050136.0,6562050136.0,0.0 | |
| 26 | +exec,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A3|budget_tokens=512|blind,A3,blind,40,40,1.0,1.0,1.0,1.0,1459.0,,1277.185709157493,1275.6410425063223,1277.185709157493,13.463333540130407,6563229784.0,6563229784.0,0.0 | |
| 27 | +exec,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A4|budget_tokens=512|blind,A4,blind,40,40,0.375,0.225,0.525,1.0,1329.0,,6299.70408254303,1357.3949374840595,6299.70408254303,13.420354051049799,6489106190.0,6489106190.0,0.0 | |
| 28 | +exec,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A5|budget_tokens=512|blind,A5,blind,40,40,0.125,0.025,0.225,1.0,938.0,,6534.907438093796,1300.7948960876092,6534.907438093796,13.370978937018663,6482995136.0,6482995136.0,0.0 | |
| 29 | +exec,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,40,40,0.225,0.1,0.35,1.0,340.0,,1280.8366029639728,1280.813749472145,1280.8366029639728,13.503895956091583,6565030904.0,6565030904.0,958.725 | |
| 30 | +exec,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A7|codec=zstd,A7,none,40,40,1.0,1.0,1.0,1.0,1304.5,,1614.060938009061,1613.9931670040824,1614.060938009061,13.793000020086765,7018315388.0,7018315388.0,0.0 | |
| 31 | +exec,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A8|budget_tokens=512|blind,A8,blind,40,40,0.0,0.0,0.0,1.0,2257.5,,299.0590829285793,104.2349580093287,299.0590829285793,13.515916944015771,6612414552.0,6612414552.0,0.0 | |
| 32 | +exec,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B0,B0,blind,40,40,1.0,1.0,1.0,1.0,69762760.0,69746688.0,1671.5779785299674,1454.5991040067747,1671.5779785299674,26.289125031325966,6443884896.0,7001595516.0,0.0 | |
| 33 | +exec,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B1,B1,blind,40,40,1.0,1.0,1.0,1.0,69762788.0,69746688.0,1678.0685833655298,1461.9321874342859,1678.0685833655298,26.193187979515642,6443491568.0,7001595516.0,0.0 | |
| 34 | +exec,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B2|bits=4,B2,blind,40,40,0.0,0.0,0.0,0.825,19650296.0,19616256.0,3499.5465414831415,3281.653458427172,3499.5465414831415,20.649228943511844,6353736674.0,7001595516.0,0.0 | |
| 35 | +exec,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B2|bits=8,B2,blind,40,40,1.0,1.0,1.0,1.0,37087110.0,37052928.0,1748.5522304777987,1527.8222084743902,1748.5522304777987,20.812437462154776,6391963660.0,7001595516.0,0.0 | |
| 36 | +exec,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B3|keep_frac=0.25,B3,blind,40,40,0.0,0.0,0.0,1.0,17452581.0,17436672.0,956.3981250976212,740.5964171048254,956.3981250976212,18.599771021399647,6328893680.0,7001595516.0,0.0 | |
| 37 | +exec,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B4|keep_frac=0.25,B4,blind,40,40,0.0,0.0,0.0,0.925,17452576.0,17436672.0,4534.33343739016,4322.83162540989,4534.33343739016,18.42766656773165,6328885488.0,7001595516.0,0.0 | |
| 38 | +exec,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B5|keep_frac=0.25|aware,B5,aware,40,40,0.0,0.0,0.0,1.0,17452621.0,17436672.0,1546.2896669632755,1297.9612504132092,1546.2896669632755,18.14260403625667,6328705264.0,7001595516.0,0.0 | |
| 39 | +exec,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B5|keep_frac=0.25|blind,B5,blind,40,40,0.0,0.0,0.0,1.0,17452621.0,17436672.0,1404.5618129894137,1157.1117919520475,1404.5618129894137,18.43020849628374,6328705264.0,7001595516.0,0.0 | |
| 40 | +exec,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B6|keep_frac=0.25|aware,B6,aware,40,40,0.0,0.0,0.0,1.0,17452580.0,17436672.0,1730.0592699903063,1481.2797500635497,1730.0592699903063,417.85912500927225,6313638200.0,7001595516.0,0.0 | |
| 41 | +exec,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,40,40,0.0,0.0,0.0,1.0,9296753.0,9263232.0,1668.3023320510983,1411.4823329728097,1668.3023320510983,17.84149999730289,6317180536.0,7001595516.0,0.0 | |
| 42 | +public_2wikimqa,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A0,A0,none,40,40,0.0625,0.0,0.1375,1.0,0.0,,61.31758342962712,61.30829197354615,61.31758342962712,13.563938031438738,6515504582.0,6515504582.0,0.0 | |
| 43 | +public_2wikimqa,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A1,A1,none,40,40,0.3302579365079365,0.19761160714285717,0.4666666666666666,1.0,26477.0,,838.0565835395828,838.0487085087225,838.0565835395828,15.187958488240838,7614567478.0,7614567478.0,0.0 | |
| 44 | +public_2wikimqa,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A2|budget_tokens=512,A2,none,40,40,0.07291666666666666,0.00625,0.15416666666666665,1.0,2053.5,,110.34681159071624,105.7645000400953,110.34681159071624,13.786938041448593,6870195718.0,6870195718.0,0.0 | |
| 45 | +public_2wikimqa,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A3|budget_tokens=512|aware,A3,aware,40,40,0.16464285714285715,0.07177678571428574,0.27214285714285713,1.0,2089.0,,120.70233299164101,118.07974940165877,120.70233299164101,13.71116645168513,6860832264.0,6860832264.0,0.0 | |
| 46 | +public_2wikimqa,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A3|budget_tokens=512|blind,A3,blind,40,40,0.034999999999999996,0.0,0.1,1.0,1924.0,,117.97743756324053,104.87143753562123,117.97743756324053,13.734270993154496,6862609914.0,6862609914.0,0.0 | |
| 47 | +public_2wikimqa,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A4|budget_tokens=512|blind,A4,blind,40,40,0.16297619047619047,0.06583333333333334,0.26882142857142854,1.0,2038.5,,8716.081208491232,107.33179206727073,8716.081208491232,13.712061976548284,6870957596.0,6870957596.0,0.0 | |
| 48 | +public_2wikimqa,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A5|budget_tokens=512|blind,A5,blind,40,40,0.058333333333333334,0.0,0.13333333333333336,1.0,1099.0,,8670.968083490152,84.7092714975588,8670.968083490152,13.663416961207986,6747823192.0,6747823192.0,0.0 | |
| 49 | +public_2wikimqa,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,40,40,0.09880952380952382,0.023809523809523808,0.19166666666666665,1.0,389.0,,104.96470803627744,104.93379150284454,104.96470803627744,13.659229502081871,6842465788.0,6842465788.0,923.775 | |
| 50 | +public_2wikimqa,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A7|codec=zstd,A7,none,40,40,0.3302579365079365,0.19761160714285717,0.4666666666666666,1.0,10766.5,,847.1706879790872,847.0414169714786,847.1706879790872,15.424749522935599,7614567478.0,7614567478.0,0.0 | |
| 51 | +public_2wikimqa,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A8|budget_tokens=512|blind,A8,blind,40,40,0.075,0.0,0.175,1.0,1816.5,,961.6785630350932,121.2931249756366,961.6785630350932,13.804020476527512,6904430324.0,6904430324.0,0.0 | |
| 52 | +public_2wikimqa,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B0,B0,blind,40,40,0.3302579365079365,0.19761160714285717,0.4666666666666666,1.0,744108792.0,744095744.0,1022.4113956210203,110.78031297074631,1022.4113956210203,42.49874997185543,8844096712.0,8844096712.0,0.0 | |
| 53 | +public_2wikimqa,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B1,B1,blind,40,40,0.3302579365079365,0.19761160714285717,0.4666666666666666,1.0,744108820.0,744095744.0,1078.9334585424513,177.0352924359031,1078.9334585424513,41.77858354523778,8844096712.0,8844096712.0,0.0 | |
| 54 | +public_2wikimqa,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B2|bits=4,B2,blind,40,40,0.21666666666666665,0.10416666666666666,0.3416666666666667,1.0,209304201.0,209276928.0,917.6457915455103,87.52035396173596,917.6457915455103,28.353708039503545,7763563872.0,7763563872.0,0.0 | |
| 55 | +public_2wikimqa,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B2|bits=8,B2,blind,40,40,0.3302579365079365,0.19761160714285717,0.4666666666666666,1.0,395328218.0,395300864.0,951.9116040901281,87.27945800637826,951.9116040901281,29.329562501516193,8176473440.0,8176473440.0,0.0 | |
| 56 | +public_2wikimqa,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B3|keep_frac=0.25,B3,blind,40,40,0.32400793650793647,0.19205357142857146,0.45912698412698416,1.0,186037056.0,186023936.0,911.9993314961903,91.53133415384218,911.9993314961903,23.624812019988894,7610430656.0,7638209748.0,0.0 | |
| 57 | +public_2wikimqa,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B4|keep_frac=0.25,B4,blind,40,40,0.0,0.0,0.0,0.825,186037051.0,186023936.0,1403.2247085124254,712.2888540616259,1403.2247085124254,23.287000018171966,7610430656.0,7638209748.0,0.0 | |
| 58 | +public_2wikimqa,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B5|keep_frac=0.25|aware,B5,aware,40,40,0.32089285714285715,0.1875,0.4596651785714284,1.0,186037096.0,186023936.0,990.1295835734345,69.1054585040547,990.1295835734345,22.277812531683594,7610430656.0,7638209748.0,0.0 | |
| 59 | +public_2wikimqa,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B5|keep_frac=0.25|blind,B5,blind,40,40,0.2838888888888889,0.15888194444444448,0.42056249999999995,1.0,186037096.0,186023936.0,959.1962915146723,64.08647989155725,959.1962915146723,22.64814602676779,7610430656.0,7638209748.0,0.0 | |
| 60 | +public_2wikimqa,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B6|keep_frac=0.25|aware,B6,aware,40,40,0.29375,0.15625,0.4375,1.0,186037011.0,186023936.0,1427.9097704566084,526.5463123796508,1427.9097704566084,493.36456251330674,7803809312.0,7803809312.0,0.0 | |
| 61 | +public_2wikimqa,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,40,40,0.32089285714285715,0.1875,0.4596651785714284,1.0,98852491.0,98825216.0,976.0725206579082,70.43647894170135,976.0725206579082,19.95449955575168,7458923884.0,7607489594.0,0.0 | |
| 62 | +public_2wikimqa,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A0,A0,none,40,40,0.1125,0.0375,0.2125,1.0,0.0,,59.17302001034841,59.158478514291346,59.17302001034841,13.196521031204611,6241993108.0,6241993108.0,0.0 | |
| 63 | +public_2wikimqa,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A1,A1,none,40,40,0.3875,0.25,0.5375,1.0,26477.0,,862.7995005808771,862.7924170577899,862.7995005808771,14.084312540944666,7239368768.0,7239368768.0,0.0 | |
| 64 | +public_2wikimqa,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A2|budget_tokens=512,A2,none,40,40,0.11666666666666665,0.025,0.225,1.0,1973.0,,106.45749949617311,97.87616651738063,106.45749949617311,13.45000002766028,6568923224.0,6568923224.0,0.0 | |
| 65 | +public_2wikimqa,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A3|budget_tokens=512|aware,A3,aware,40,40,0.21291666666666664,0.11041666666666665,0.3300312499999998,1.0,1940.5,,113.71260363375768,110.9033121028915,113.71260363375768,13.465750496834517,6559346776.0,6559346776.0,0.0 | |
| 66 | +public_2wikimqa,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A3|budget_tokens=512|blind,A3,blind,40,40,0.1125,0.025,0.2125,1.0,1735.0,,114.57770806737244,96.89510404132307,114.57770806737244,13.402666547335684,6562443352.0,6562443352.0,0.0 | |
| 67 | +public_2wikimqa,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A4|budget_tokens=512|blind,A4,blind,40,40,0.20347222222222222,0.09791666666666667,0.3208506944444443,1.0,1749.5,,8053.586145979352,97.53939497750252,8053.586145979352,13.36843753233552,6583652440.0,6583652440.0,0.0 | |
| 68 | +public_2wikimqa,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A5|budget_tokens=512|blind,A5,blind,40,40,0.12333333333333334,0.04,0.23166666666666663,1.0,810.0,,7940.129436494317,80.12141706421971,7940.129436494317,13.376353948842734,6494488374.0,6494488374.0,0.0 | |
| 69 | +public_2wikimqa,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,40,40,0.11000000000000001,0.025,0.22000000000000003,1.0,466.5,,126.47829105844721,126.43012392800301,126.47829105844721,13.430749473627657,6640562264.0,6640562264.0,1217.275 | |
| 70 | +public_2wikimqa,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A7|codec=zstd,A7,none,40,40,0.3875,0.25,0.5375,1.0,10766.5,,986.8479584692977,986.7087295278907,986.8479584692977,14.408541494049132,7239368768.0,7239368768.0,0.0 | |
| 71 | +public_2wikimqa,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A8|budget_tokens=512|blind,A8,blind,40,40,0.0625,0.0,0.1375,1.0,1721.5,,667.4353124690242,109.33960444526747,667.4353124690242,13.598332996480167,6599094360.0,6599094360.0,0.0 | |
| 72 | +public_2wikimqa,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B0,B0,blind,40,40,0.3625,0.225,0.5041666666666667,1.0,254580530.0,254564352.0,1078.0544368899427,123.88258392456919,1078.0544368899427,58.98822902236134,7024730428.0,7239360576.0,0.0 | |
| 73 | +public_2wikimqa,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B1,B1,blind,40,40,0.3625,0.225,0.5041666666666667,1.0,254580558.0,254564352.0,1081.1359789804555,142.88037497317418,1081.1359789804555,54.69964555231854,7024730316.0,7239360576.0,0.0 | |
| 74 | +public_2wikimqa,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B2|bits=4,B2,blind,40,40,0.003913630229419702,0.0,0.010458839406207825,0.975,71630478.0,71596224.0,1630.7963539729826,739.3143955268897,1630.7963539729826,29.354833532124758,6681390136.0,7239360576.0,0.0 | |
| 75 | +public_2wikimqa,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B2|bits=8,B2,blind,40,40,0.3625,0.225,0.5041666666666667,1.0,135271688.0,135237312.0,1035.3826249483973,97.3766659735702,1035.3826249483973,30.708041042089462,6821831068.5,7239360576.0,0.0 | |
| 76 | +public_2wikimqa,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B3|keep_frac=0.25,B3,blind,40,40,0.39464285714285713,0.25416666666666665,0.5488392857142856,1.0,63661888.0,63645696.0,1020.8498335559852,81.72633306821808,1020.8498335559852,24.91972898133099,6605316300.0,7239360576.0,0.0 | |
| 77 | +public_2wikimqa,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B4|keep_frac=0.25,B4,blind,40,40,0.008613445378151261,0.0,0.024369747899159667,0.925,63661883.0,63645696.0,1539.1613344545476,676.473917614203,1539.1613344545476,24.953124986495823,6605316300.0,7239360576.0,0.0 | |
| 78 | +public_2wikimqa,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B5|keep_frac=0.25|aware,B5,aware,40,40,0.3392857142857143,0.2,0.4833333333333333,1.0,63661928.0,63645696.0,1062.0520829688758,82.09260407602414,1062.0520829688758,24.084812554065138,6605316300.0,7239360576.0,0.0 | |
| 79 | +public_2wikimqa,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B5|keep_frac=0.25|blind,B5,blind,40,40,0.30625,0.175,0.45,1.0,63661928.0,63645696.0,1037.0062295696698,79.50931205414236,1037.0062295696698,24.317916948348284,6605316300.0,7239360576.0,0.0 | |
| 80 | +public_2wikimqa,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B6|keep_frac=0.25|aware,B6,aware,40,40,0.36428571428571427,0.228482142857143,0.5083630952380951,1.0,63661830.0,63645696.0,1445.9590209880844,466.9628744595684,1445.9590209880844,398.6886665225029,6655922112.0,7239360576.0,0.0 | |
| 81 | +public_2wikimqa,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,40,40,0.35178571428571426,0.21845238095238093,0.4916666666666666,1.0,33846113.5,33811776.0,1065.1935209752992,79.09508352167904,1065.1935209752992,19.883000059053302,6554773592.0,7239360576.0,0.0 | |
| 82 | +public_qasper,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A0,A0,none,40,40,0.053520674727571285,0.00762987012987013,0.11977830646365119,1.0,0.0,,65.9553125151433,65.94904151279479,65.9553125151433,13.496875006239861,6510474664.0,6510474664.0,0.0 | |
| 83 | +public_qasper,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A1,A1,none,40,40,0.2537783280350416,0.15373085330146563,0.36433162174894096,1.0,24485.5,,727.1668530884199,727.1603115950711,727.1668530884199,14.904125011526048,7465718848.0,7465718848.0,0.0 | |
| 84 | +public_qasper,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A2|budget_tokens=512,A2,none,40,40,0.06596767217456873,0.02368412239101894,0.1264588058014782,1.0,2645.0,,129.87125013023615,127.00175010832027,129.87125013023615,13.727125013247132,6865649128.0,6865649128.0,0.0 | |
| 85 | +public_qasper,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A3|budget_tokens=512|aware,A3,aware,40,40,0.23695446852096466,0.14541538242944893,0.3455378195824967,1.0,2503.5,,158.11447944724932,156.55895846430212,158.11447944724932,13.684041507076472,6856752608.0,6856752608.0,0.0 | |
| 86 | +public_qasper,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A3|budget_tokens=512|blind,A3,blind,40,40,0.14415518358453142,0.06653808284107197,0.22890076522209668,1.0,2108.5,,149.97426996706054,143.4077289304696,149.97426996706054,13.658125011716038,6859865572.0,6859865572.0,0.0 | |
| 87 | +public_qasper,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A4|budget_tokens=512|blind,A4,blind,40,40,0.19959273932500582,0.10820102144256978,0.30105128414152005,1.0,2603.0,,8184.926540940069,143.69518699822947,8184.926540940069,13.65083345444873,6863125988.0,6863125988.0,0.0 | |
| 88 | +public_qasper,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A5|budget_tokens=512|blind,A5,blind,40,40,0.05102564102564102,0.008333333333333333,0.11103311965811961,1.0,968.0,,8221.8351039337,81.11052104504779,8221.8351039337,13.581979554146528,6697516120.0,6697516120.0,0.0 | |
| 89 | +public_qasper,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,40,40,0.0661431623931624,0.015382211538461544,0.13314583333333332,1.0,431.0,,111.73445841995999,111.69662489555776,111.73445841995999,13.675124966539443,6877355576.0,6877355576.0,1288.45 | |
| 90 | +public_qasper,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A7|codec=zstd,A7,none,40,40,0.2537783280350416,0.15373085330146563,0.36433162174894096,1.0,9070.5,,785.8203329960816,785.5639375047758,785.8203329960816,15.055291471071541,7465718848.0,7465718848.0,0.0 | |
| 91 | +public_qasper,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A8|budget_tokens=512|blind,A8,blind,40,40,0.22771284244269147,0.1316498298861027,0.33295768298472694,1.0,2545.5,,770.1807499979623,150.92641697265208,770.1807499979623,13.779875007458031,6907231900.0,6907231900.0,0.0 | |
| 92 | +public_qasper,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B0,B0,blind,40,40,0.2537783280350416,0.15373085330146563,0.36433162174894096,1.0,578040564.0,578027520.0,966.9294175691903,141.73779159318656,966.9294175691903,38.254000479355454,8312747188.0,8312747188.0,0.0 | |
| 93 | +public_qasper,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B1,B1,blind,40,40,0.2537783280350416,0.15373085330146563,0.36433162174894096,1.0,578040592.0,578027520.0,1006.8175835185684,191.32306252140552,1006.8175835185684,36.52475000126287,8312747188.0,8312747188.0,0.0 | |
| 94 | +public_qasper,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B2|bits=4,B2,blind,40,40,0.25432579117832765,0.153750429395278,0.363530122247789,1.0,162597464.0,162570240.0,875.7963750394993,123.03260347107425,875.7963750394993,24.27243796410039,7439708640.0,7458149440.0,0.0 | |
| 95 | +public_qasper,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B2|bits=8,B2,blind,40,40,0.2537783280350416,0.15373085330146563,0.36433162174894096,1.0,307104450.0,307077120.0,923.8226665765978,128.16997891059145,923.8226665765978,25.769770552869886,7759564508.0,7759564508.0,0.0 | |
| 96 | +public_qasper,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B3|keep_frac=0.25,B3,blind,40,40,0.16082072722300209,0.08518288294532156,0.2510588201241594,1.0,144519982.5,144506880.0,827.808978559915,88.17443740554154,827.808978559915,21.28720801556483,7362794676.0,7458149440.0,0.0 | |
| 97 | +public_qasper,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B4|keep_frac=0.25,B4,blind,40,40,0.07447303921568628,0.011764705882352943,0.159375,0.85,144519977.0,144506880.0,1270.7714784191921,697.6080205058679,1270.7714784191921,20.92524996260181,7362794676.0,7458149440.0,0.0 | |
| 98 | +public_qasper,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B5|keep_frac=0.25|aware,B5,aware,40,40,0.24277583985218615,0.151606606366538,0.34430225224520655,1.0,144520021.0,144506880.0,904.3003126280382,109.62083359481767,904.3003126280382,20.468145434278995,7362794676.0,7458149440.0,0.0 | |
| 99 | +public_qasper,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B5|keep_frac=0.25|blind,B5,blind,40,40,0.1870317755238296,0.09726531188192125,0.28550238619193186,1.0,144520022.0,144506880.0,885.7176880119368,82.61193748330697,885.7176880119368,20.840229000896215,7362794676.0,7458149440.0,0.0 | |
| 100 | +public_qasper,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B6|keep_frac=0.25|aware,B6,aware,40,40,0.243191089563836,0.1529984118743194,0.34138962849027604,1.0,144519925.0,144506880.0,1196.1688324809074,467.6350621157326,1196.1688324809074,337.63170801103115,7496383140.0,7496383140.0,0.0 | |
| 101 | +public_qasper,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,40,40,0.23538707665459943,0.1437460416846976,0.33762197165669905,1.0,76796546.0,76769280.0,894.2440829705447,95.0739789986983,894.2440829705447,19.250125042162836,7227740640.0,7458149440.0,0.0 | |
| 102 | +public_qasper,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A0,A0,none,40,40,0.04142585580594076,0.007637997532383382,0.09814090546216682,1.0,0.0,,46.06579209212214,46.056688064709306,46.06579209212214,13.382770994212478,6219424104.0,6219424104.0,0.0 | |
| 103 | +public_qasper,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A1,A1,none,40,40,0.3524582923320977,0.23883181230104608,0.47279664560678997,1.0,24485.5,,745.9065829752944,745.8995829802006,745.9065829752944,14.21087549533695,7155474496.0,7155474496.0,0.0 | |
| 104 | +public_qasper,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A2|budget_tokens=512,A2,none,40,40,0.0878869286287089,0.028754152823920263,0.16423767995570318,1.0,2601.5,,108.99041715310887,103.18029159680009,108.99041715310887,13.605854008346796,6564311128.0,6564311128.0,0.0 | |
| 105 | +public_qasper,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A3|budget_tokens=512|aware,A3,aware,40,40,0.20037559549133369,0.11038688582962186,0.29392695953636033,1.0,2489.0,,121.99314642930403,120.10777142131701,121.99314642930403,13.487062067724764,6556938328.0,6556938328.0,0.0 | |
| 106 | +public_qasper,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A3|budget_tokens=512|blind,A3,blind,40,40,0.17671057593077716,0.08363678728070176,0.28627020446336426,1.0,1921.5,,125.1891881111078,115.41158257750794,125.1891881111078,13.500208500772715,6557331544.0,6557331544.0,0.0 | |
| 107 | +public_qasper,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A4|budget_tokens=512|blind,A4,blind,40,40,0.1712858923966609,0.08545177548376676,0.27294349495381276,1.0,1576.5,,5029.291937593371,83.08352145832032,5029.291937593371,13.349354558158666,6488081952.0,6488081952.0,0.0 | |
| 108 | +public_qasper,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A5|budget_tokens=512|blind,A5,blind,40,40,0.09325396825396826,0.025,0.18214285714285713,1.0,864.5,,7716.917958576232,75.53093699971214,7716.917958576232,13.376458489801735,6465111492.0,6465111492.0,0.0 | |
| 109 | +public_qasper,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,40,40,0.0916328761677599,0.024966209501093222,0.17325129198966407,1.0,402.0,,102.26277098990977,102.22927096765488,102.26277098990977,13.375187467318028,6580244568.0,6580244568.0,1275.675 | |
| 110 | +public_qasper,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A7|codec=zstd,A7,none,40,40,0.3524582923320977,0.23883181230104608,0.47279664560678997,1.0,9070.5,,764.1158540500328,763.9933960163034,764.1158540500328,14.18656250461936,7155474496.0,7155474496.0,0.0 | |
| 111 | +public_qasper,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A8|budget_tokens=512|blind,A8,blind,40,40,0.1703928482427472,0.095372260168256,0.2543030919048409,1.0,2485.5,,584.9466664367355,130.6202500127256,584.9466664367355,13.61447898671031,6607204440.0,6607204440.0,0.0 | |
| 112 | +public_qasper,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B0,B0,blind,40,40,0.352023064477515,0.2383965844464634,0.4719260368517915,1.0,189331228.0,189315072.0,868.3839794830419,136.56529149739072,868.3839794830419,45.000125479418784,6814936304.0,7155474496.0,0.0 | |
| 113 | +public_qasper,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B1,B1,blind,40,40,0.352023064477515,0.2383965844464634,0.4719260368517915,1.0,189331256.0,189315072.0,887.9102920764126,149.75345897255465,887.9102920764126,42.2816455247812,6814936248.0,7155474496.0,0.0 | |
| 114 | +public_qasper,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B2|bits=4,B2,blind,40,40,0.006331743508214097,0.0,0.015313487016428186,0.85,53279094.0,53244864.0,1377.5208949227817,727.0087914657779,1377.5208949227817,23.64412450697273,6560093950.5,7155474496.0,0.0 | |
| 115 | +public_qasper,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B2|bits=8,B2,blind,40,40,0.37503821241201774,0.2544268509119095,0.503267557517078,1.0,100607913.0,100573632.0,852.9593333369121,107.36995853949338,852.9593333369121,24.1553335217759,6662213424.0,7155474496.0,0.0 | |
| 116 | +public_qasper,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B3|keep_frac=0.25,B3,blind,40,40,0.18833570671908945,0.09931079256446874,0.29042796386027525,1.0,47349560.0,47333376.0,816.352813562844,73.56977043673396,816.352813562844,22.071291517931968,6504754360.0,7155474496.0,0.0 | |
| 117 | +public_qasper,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B4|keep_frac=0.25,B4,blind,40,40,0.06238475229321912,0.015609953325342348,0.13097708649410586,0.9,47349555.0,47333376.0,1191.2303749704733,497.9330000351183,1191.2303749704733,22.010812477674335,6504754360.0,7155474496.0,0.0 | |
| 118 | +public_qasper,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B5|keep_frac=0.25|aware,B5,aware,40,40,0.2865065059897759,0.18546910413002085,0.40048248270099884,1.0,47349600.0,47333376.0,856.4752705860883,91.3222705712542,856.4752705860883,21.61108300788328,6504328376.0,7155474496.0,0.0 | |
| 119 | +public_qasper,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B5|keep_frac=0.25|blind,B5,blind,40,40,0.20624202311879092,0.1117775040316477,0.3167712243764782,1.0,47349600.0,47333376.0,849.5922079309821,62.9603749839589,849.5922079309821,21.98331250110641,6504328376.0,7155474496.0,0.0 | |
| 120 | +public_qasper,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B6|keep_frac=0.25|aware,B6,aware,40,40,0.2652581506721279,0.16187616797075396,0.38009561979821493,1.0,47349474.0,47333376.0,1156.025978445541,388.32566648488864,1156.025978445541,306.9419994717464,6541476740.0,7155474496.0,0.0 | |
| 121 | +public_qasper,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,40,40,0.2844661026716981,0.18117210682811177,0.4016838943872298,1.0,25180151.5,25145856.0,865.985604992602,93.56572898104787,865.985604992602,19.180521019734442,6464650960.0,7155474496.0,0.0 | |
| 122 | +synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A0,A0,none,200,40,0.0,0.0,0.0,1.0,0.0,,157.36941754585132,157.36408397788182,157.36515069147572,23.465062549803406,6555547060.0,6555547060.0,0.0 | |
| 123 | +synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A1,A1,none,200,40,0.99,0.975,1.0,1.0,29207.5,,2861.687187454663,2861.679062480107,2861.680687475018,27.46989601291716,7576794164.0,7576794164.0,0.0 | |
| 124 | +synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A2|budget_tokens=512,A2,none,200,40,0.205,0.17,0.24,1.0,2347.0,,405.87554196827114,402.4369170074351,402.91585446102545,26.229520968627185,6810402320.0,6810402320.0,0.0 | |
| 125 | +synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A3|budget_tokens=512|aware,A3,aware,200,40,0.995,0.985,1.0,1.0,1604.5,,532.9524165135808,530.521520995535,532.9524165135808,24.227604502812028,6806912504.0,6806912504.0,0.0 | |
| 126 | +synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A3|budget_tokens=512|blind,A3,blind,200,40,0.405,0.4,0.415,1.0,1563.5,,444.42235393216833,436.8094165693037,438.5126998764463,24.473979545291513,6803176952.0,6803176952.0,0.0 | |
| 127 | +synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A4|budget_tokens=512|aware,A4,aware,120,40,0.8333333333333334,0.7666666666666667,0.9,1.0,1509.0,,18769.84793745214,520.637666573748,18769.84793745214,25.514833512715995,6817431036.0,6817431036.0,0.0 | |
| 128 | +synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A4|budget_tokens=512|blind,A4,blind,200,40,0.44,0.385,0.495,1.0,1838.5,,18976.632187899668,444.4485829444602,4166.054411872756,25.369146023876965,6817431036.0,6817431036.0,0.0 | |
| 129 | +synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A5|budget_tokens=512|aware,A5,aware,120,40,0.95,0.9083333333333333,0.9833333333333333,1.0,233.5,,8669.620249595027,422.92658297810704,8669.620249595027,26.59820852568373,6607812288.0,6607812288.0,0.0 | |
| 130 | +synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A5|budget_tokens=512|blind,A5,blind,200,40,0.125,0.09,0.155,1.0,842.0,,18998.95481200656,344.1750835045241,4091.6990083642304,23.827395518310368,6734748760.0,6734748760.0,0.0 | |
| 131 | +synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,200,40,0.175,0.135,0.215,1.0,707.0,,492.9024174925871,492.8722715121694,492.87830070825294,25.794854445848614,6933195852.0,6933195852.0,1367.27 | |
| 132 | +synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A7|codec=zstd,A7,none,200,40,0.99,0.975,1.0,1.0,2726.0,,2857.3816449497826,2857.2952494141646,2857.312528521288,27.074062498286366,7576794164.0,7576794164.0,0.0 | |
| 133 | +synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A8|budget_tokens=512|blind,A8,blind,200,40,0.0,0.0,0.0,0.0,,,0.0,0.0,0.0,,,,0.0 | |
| 134 | +synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B0,B0,blind,200,40,0.99,0.975,1.0,1.0,651268854.0,651255808.0,3253.5364581272006,393.2519589434378,973.5832870006561,136.40537502942607,8593077474.0,8593077474.0,0.0 | |
| 135 | +synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B1,B1,blind,200,40,0.99,0.975,1.0,1.0,651268882.0,651255808.0,3351.503874640912,505.0313540850766,1057.6043623499572,144.29387502605096,8593069282.0,8593069282.0,0.0 | |
| 136 | +synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B2|bits=4,B2,blind,200,40,0.975,0.945,0.995,1.0,183192937.0,183165696.0,3111.2300624372438,335.1737505290657,882.7701129950583,106.28564545186237,7628087269.0,7628087269.0,0.0 | |
| 137 | +synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B2|bits=8,B2,blind,200,40,0.99,0.975,1.0,1.0,346006984.0,345979648.0,3146.7745005502366,358.00489655230194,916.1296371254139,108.4380624233745,7988651786.0,7988651786.0,0.0 | |
| 138 | +synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B3|keep_frac=0.25,B3,blind,200,40,0.185,0.16,0.21,1.0,162812727.0,162799616.0,3009.2775429366156,277.9904584749602,822.304554330185,89.87866656389087,7514240212.0,7564825652.0,0.0 | |
| 139 | +synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B4|keep_frac=0.25,B4,blind,200,40,0.0,0.0,0.0,0.96,162812721.5,162799616.0,4281.923291040584,1580.5572919198312,2123.8540127058513,89.75787495728582,7514240212.0,7564825652.0,0.0 | |
| 140 | +synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B5|keep_frac=0.25|aware,B5,aware,200,40,0.985,0.965,1.0,1.0,162812766.0,162799616.0,3259.5277500804514,291.60412499913946,3259.5277500804514,91.043604479637,7514240212.0,7564825652.0,0.0 | |
| 141 | +synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B5|keep_frac=0.25|blind,B5,blind,200,40,0.19,0.12,0.265,1.0,162812765.5,162799616.0,3129.6013329993,183.34420851897448,757.7406506170519,92.93381206225604,7514240212.0,7564825652.0,0.0 | |
| 142 | +synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B6|keep_frac=0.25|aware,B6,aware,200,40,0.975,0.95,0.995,1.0,162812673.0,162799616.0,3922.836207493674,962.149562605191,3922.836207493674,749.9465415021405,7672888236.0,7672888236.0,0.0 | |
| 143 | +synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,200,40,0.985,0.965,1.0,1.0,86514564.5,86487296.0,3211.8879585177638,287.61656302958727,3211.8879585177638,84.8972704843618,7378286352.0,7564825652.0,0.0 | |
| 144 | +synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A0,A0,none,200,40,0.0,0.0,0.0,1.0,0.0,,50.41495896875858,50.405958958435804,50.40775896050036,13.265561952721328,6243951240.0,6243951240.0,0.0 | |
| 145 | +synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A1,A1,none,200,40,0.99,0.975,1.0,1.0,29207.5,,950.7843535975553,950.7768115727231,950.7783199776895,14.600520953536034,7155474496.0,7155474496.0,0.0 | |
| 146 | +synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A2|budget_tokens=512,A2,none,200,40,0.195,0.16,0.23,1.0,2237.5,,111.21093755355105,106.68506246292964,107.22286257660016,13.600957987364382,6567653464.0,6567653464.0,0.0 | |
| 147 | +synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A3|budget_tokens=512|aware,A3,aware,200,40,0.97,0.945,0.99,1.0,1359.0,,208.21972895646468,205.5006460286677,208.21972895646468,13.554833538364619,6562443352.0,6562443352.0,0.0 | |
| 148 | +synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A3|budget_tokens=512|blind,A3,blind,200,40,0.375,0.355,0.395,1.0,1243.0,,157.0329790120013,152.3254174971953,153.43078373698518,13.57818697579205,6562246744.0,6562246744.0,0.0 | |
| 149 | +synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A4|budget_tokens=512|aware,A4,aware,120,40,0.9416666666666667,0.8916666666666667,0.9833333333333333,1.0,379.5,,3055.9733340051025,189.2200205475092,3055.9733340051025,13.356083014514297,6351775108.0,6351775108.0,0.0 | |
| 150 | +synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A4|budget_tokens=512|blind,A4,blind,200,40,0.375,0.29,0.46,1.0,1424.5,,7449.7145840432495,127.20972893293947,1638.8054550508969,13.581104576587677,6567653464.0,6567653464.0,0.0 | |
| 151 | +synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A5|budget_tokens=512|aware,A5,aware,120,40,1.0,1.0,1.0,1.0,118.0,,2137.8979585133493,178.15022950526327,2137.8979585133493,13.383313023950905,6300656332.0,6300656332.0,0.0 | |
| 152 | +synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A5|budget_tokens=512|blind,A5,blind,200,40,0.15,0.12,0.175,1.0,827.0,,8156.952459132299,82.95993698993698,1699.9364422634244,13.478271022904664,6524249846.0,6524249846.0,0.0 | |
| 153 | +synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,200,40,0.18,0.145,0.215,1.0,627.0,,169.26231351681054,169.23870902974159,169.24342992715538,13.843645516317338,6813358062.0,6813358062.0,1490.29 | |
| 154 | +synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A7|codec=zstd,A7,none,200,40,0.99,0.975,1.0,1.0,2726.0,,1031.9313738727942,1031.8554784171283,1031.8706575082615,14.829437481239438,7155474496.0,7155474496.0,0.0 | |
| 155 | +synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A8|budget_tokens=512|blind,A8,blind,200,40,0.135,0.09,0.185,1.0,2566.5,,1293.5829174821265,162.30137506499887,364.1857292270288,13.750895974226296,6603747416.0,6603747416.0,0.0 | |
| 156 | +synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B0,B0,blind,200,40,0.99,0.975,1.0,1.0,215559973.0,215543808.0,1760.9770625131205,187.03570862999186,489.1586328856647,47.34012502012774,6902325564.0,7155474496.0,0.0 | |
| 157 | +synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B1,B1,blind,200,40,0.99,0.975,1.0,1.0,215560001.0,215543808.0,1249.4945833459496,211.0927085741423,428.1928248470649,47.08545847097412,6902210788.0,7155474496.0,0.0 | |
| 158 | +synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B2|bits=4,B2,blind,200,40,0.0,0.0,0.0,0.925,60655936.0,60621696.0,1706.1032095225528,737.6006674603559,957.3284577345476,28.023312508594245,6617885472.0,7155474496.0,0.0 | |
| 159 | +synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B2|bits=8,B2,blind,200,40,0.99,0.975,1.0,1.0,114541977.0,114507648.0,1375.615374010522,174.04247901868075,427.2855912684463,31.199354503769428,6737391200.0,7155474496.0,0.0 | |
| 160 | +synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B3|keep_frac=0.25,B3,blind,200,40,0.2,0.175,0.23,1.0,53892924.5,53876736.0,1106.2013980117626,122.37893755082041,344.84630380757153,24.08345852745697,6547349820.0,7155474496.0,0.0 | |
| 161 | +synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B4|keep_frac=0.25,B4,blind,200,40,0.0,0.0,0.0,0.93,53892919.5,53876736.0,1658.0170001252554,676.7245414666831,892.330970952753,24.060583498794585,6547349820.0,7155474496.0,0.0 | |
| 162 | +synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B5|keep_frac=0.25|aware,B5,aware,200,40,0.78,0.725,0.83,1.0,53892964.5,53876736.0,1236.3030216074549,136.36277109617367,1236.3030216074549,23.683937499299645,6546481380.0,7155474496.0,0.0 | |
| 163 | +synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B5|keep_frac=0.25|blind,B5,blind,200,40,0.12,0.075,0.17,1.0,53892964.5,53876736.0,1218.1062293238938,101.19929199572653,340.085291385185,23.96877051796764,6546481380.0,7155474496.0,0.0 | |
| 164 | +synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B6|keep_frac=0.25|aware,B6,aware,200,40,0.66,0.61,0.705,1.0,53892854.5,53876736.0,1639.2308954964392,539.650562859606,1639.2308954964392,414.88808300346136,6584983866.0,7155474496.0,0.0 | |
| 165 | +synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,200,40,0.785,0.73,0.835,1.0,28656329.0,28622016.0,1268.601355026476,140.13310411246493,1268.601355026476,21.49270853260532,6506618028.0,7155474496.0,0.0 | |
modified
results/tables/E4_core_h4_primary_tests.csv
+1 −1
@@ -1,2 +1,2 @@ | ||
| 1 | 1 | a,b,diff,lo,hi,p,n,n_clusters,mean_a,mean_b,rel_change,name,hypothesis,p_holm |
| 2 | −A5|closed|qwen3b,A4|closed|qwen3b,-0.1037037037037037,-0.1962962962962963,-0.014814814814814815,0.029,270,18,0.27037037037037037,0.37407407407407406,-0.27722772277227725,T5 A5 chain vs A4 chain at 4 handoffs (closed),H5,0.029 | |
| 2 | +A5|closed|qwen3b,A4|closed|qwen3b,-0.12,-0.20666666666666667,-0.02991666666666712,0.013,300,20,0.26666666666666666,0.38666666666666666,-0.3103448275862069,T5 A5 chain vs A4 chain at 4 handoffs (closed),H5,0.013 | |
modified
results/tables/E4_core_handoffs.csv
+24 −24
@@ -1,25 +1,25 @@ | ||
| 1 | 1 | chain,handoffs,accuracy,acc_lo,acc_hi,retention,ret_lo,ret_hi,unsupported_mean,fetched_bytes_mean,msg_bytes_mean,n,n_docs |
| 2 | −A4|closed|qwen3b-llama3b,1,0.3764705882352941,0.2920588235294118,0.4627450980392157,0.2997403349599513,0.21457867065318473,0.3869957002281858,0.0,0.0,1348.7058823529412,255,17 | |
| 3 | −A4|closed|qwen3b-llama3b,2,0.3803921568627451,0.3058823529411765,0.4588235294117647,0.2997403349599513,0.21457867065318473,0.3869957002281858,0.0,0.0,1295.9411764705883,255,17 | |
| 4 | −A4|closed|qwen3b-llama3b,4,0.37254901960784315,0.29990196078431375,0.44911764705882345,0.2939994929697927,0.20919293364752228,0.3796107713871142,0.0,0.0,1196.8823529411766,255,17 | |
| 5 | −A4|closed|qwen3b-llama3b,8,0.3607843137254902,0.27450980392156865,0.4569607843137254,0.28477327682351017,0.20162554174350086,0.3731548822718816,0.0,0.0,1087.4117647058824,255,17 | |
| 6 | −A4|closed|qwen3b,1,0.3851851851851852,0.3037037037037037,0.46296296296296297,0.31556672660747537,0.23471613693176427,0.3999038582684665,0.0,0.0,1339.2777777777778,270,18 | |
| 7 | −A4|closed|qwen3b,2,0.37407407407407406,0.29259259259259257,0.45555555555555555,0.31198249721679433,0.23020870973034613,0.397220313896269,0.0,0.0,1189.5555555555557,270,18 | |
| 8 | −A4|closed|qwen3b,4,0.37407407407407406,0.29259259259259257,0.45555555555555555,0.3085102749945721,0.22808095562665784,0.3920547786340022,0.0,0.0,1162.111111111111,270,18 | |
| 9 | −A4|closed|qwen3b,8,0.3814814814814815,0.29259259259259257,0.4666666666666667,0.3085102749945721,0.22808095562665784,0.3920547786340022,0.0,0.0,1161.0555555555557,270,18 | |
| 10 | −A4|repairable|qwen3b,1,0.3764705882352941,0.2920588235294118,0.4627450980392157,0.2997403349599513,0.21457867065318473,0.3869957002281858,0.0,0.0,1348.7058823529412,255,17 | |
| 11 | −A4|repairable|qwen3b,2,0.4117647058823529,0.3333333333333333,0.49019607843137253,0.34433809830771467,0.2635025835750893,0.4163276358495137,0.0,830.1764705882352,1289.8235294117646,255,17 | |
| 12 | −A4|repairable|qwen3b,4,0.4235294117647059,0.3333333333333333,0.49411764705882355,0.3715110887159992,0.29655520277764474,0.43621401726286024,0.0,2490.529411764706,1212.6470588235295,255,17 | |
| 13 | −A4|repairable|qwen3b,8,0.42745098039215684,0.33725490196078434,0.5019607843137255,0.3715110887159992,0.29655520277764474,0.43621401726286024,0.0,5811.235294117647,1211.5294117647059,255,17 | |
| 14 | −A5|closed|qwen3b-llama3b,1,0.2823529411764706,0.24313725490196078,0.3176470588235294,0.17483857864652055,0.1494914321297303,0.19947843566193868,0.0,0.0,744.7058823529412,255,17 | |
| 15 | −A5|closed|qwen3b-llama3b,2,0.30196078431372547,0.2724509803921569,0.3333333333333333,0.20163529494851135,0.18206329172922364,0.22029894567998026,0.0,0.0,960.7647058823529,255,17 | |
| 16 | −A5|closed|qwen3b-llama3b,4,0.2980392156862745,0.26666666666666666,0.3333333333333333,0.20163529494851135,0.18206329172922364,0.22029894567998026,0.0,0.0,983.5294117647059,255,17 | |
| 17 | −A5|closed|qwen3b-llama3b,8,0.2980392156862745,0.2685294117647059,0.3333333333333333,0.20163529494851135,0.18206329172922364,0.22029894567998026,0.0,0.0,983.5294117647059,255,17 | |
| 18 | −A5|closed|qwen3b,1,0.2777777777777778,0.24444444444444444,0.3167592592592592,0.18136464051658566,0.15648040685178966,0.21033222834242798,0.0,0.0,749.7777777777778,270,18 | |
| 19 | −A5|closed|qwen3b,2,0.26296296296296295,0.23333333333333334,0.29824074074074064,0.1798353106270407,0.1509785338633097,0.21144416514719916,0.0,0.0,706.4444444444445,270,18 | |
| 20 | −A5|closed|qwen3b,4,0.27037037037037037,0.24074074074074073,0.3074074074074074,0.1798353106270407,0.1509785338633097,0.21144416514719916,0.0,0.0,706.4444444444445,270,18 | |
| 21 | −A5|closed|qwen3b,8,0.27450980392156865,0.23921568627450981,0.31186274509803913,0.17321928817523768,0.1417754973886688,0.20031953957329943,0.0,0.0,698.8235294117648,255,17 | |
| 22 | −A5|repairable|qwen3b,1,0.2823529411764706,0.24313725490196078,0.3176470588235294,0.17483857864652055,0.1494914321297303,0.19947843566193868,0.0,0.0,744.7058823529412,255,17 | |
| 23 | −A5|repairable|qwen3b,2,0.26666666666666666,0.22931372549019613,0.3058823529411765,0.1876961353547222,0.15947604023307319,0.21310193990334425,0.0,898.2941176470588,690.7058823529412,255,17 | |
| 24 | −A5|repairable|qwen3b,4,0.27058823529411763,0.23137254901960785,0.30980392156862746,0.19416234466723137,0.17161243865971046,0.21600566106635635,0.0,2475.235294117647,729.7647058823529,255,17 | |
| 25 | −A5|repairable|qwen3b,8,0.27058823529411763,0.23137254901960785,0.30980392156862746,0.19416234466723137,0.17161243865971046,0.21600566106635635,0.0,5629.117647058823,729.7647058823529,255,17 | |
| 2 | +A4|closed|qwen3b-llama3b,1,0.39666666666666667,0.31333333333333335,0.4784166666666666,0.3213477162843902,0.24051447018751054,0.3990021508568352,0.0,0.0,1335.1,300,20 | |
| 3 | +A4|closed|qwen3b-llama3b,2,0.4033333333333333,0.33,0.4784166666666666,0.31896676390343776,0.2388578879687949,0.396724937377807,0.0,0.0,1292.7,300,20 | |
| 4 | +A4|closed|qwen3b-llama3b,4,0.39666666666666667,0.31983333333333336,0.4766666666666667,0.31332947245422715,0.2338895058259791,0.39140045635421616,0.0,0.0,1204.35,300,20 | |
| 5 | +A4|closed|qwen3b-llama3b,8,0.38666666666666666,0.29333333333333333,0.4766666666666667,0.305487188729887,0.22485206259538051,0.38613828395117317,0.0,0.0,1111.65,300,20 | |
| 6 | +A4|closed|qwen3b,1,0.39666666666666667,0.31333333333333335,0.4784166666666666,0.3213477162843902,0.24051447018751054,0.3990021508568352,0.0,0.0,1335.1,300,20 | |
| 7 | +A4|closed|qwen3b,2,0.38666666666666666,0.29825,0.4717499999999999,0.31812190983277727,0.23827969389124584,0.3963697907674928,0.0,0.0,1200.35,300,20 | |
| 8 | +A4|closed|qwen3b,4,0.38666666666666666,0.29825,0.4717499999999999,0.3149969098327773,0.23706777575550922,0.3915214606368333,0.0,0.0,1175.65,300,20 | |
| 9 | +A4|closed|qwen3b,8,0.3933333333333333,0.30333333333333334,0.48,0.3149969098327773,0.23706777575550922,0.3915214606368333,0.0,0.0,1174.7,300,20 | |
| 10 | +A4|repairable|qwen3b,1,0.39666666666666667,0.31333333333333335,0.4784166666666666,0.3213477162843902,0.24051447018751054,0.3990021508568352,0.0,0.0,1335.1,300,20 | |
| 11 | +A4|repairable|qwen3b,2,0.42333333333333334,0.35,0.5001666666666665,0.3577173535915275,0.28124865199064863,0.4237092895154752,0.05,844.1,1283.2,300,20 | |
| 12 | +A4|repairable|qwen3b,4,0.43333333333333335,0.36333333333333334,0.5066666666666667,0.3808143954385693,0.312176448615584,0.4407750070228039,0.05,2532.3,1214.45,300,20 | |
| 13 | +A4|repairable|qwen3b,8,0.43666666666666665,0.36491666666666667,0.5084166666666666,0.3808143954385693,0.312176448615584,0.4407750070228039,0.05,5908.7,1213.5,300,20 | |
| 14 | +A5|closed|qwen3b-llama3b,1,0.2733333333333333,0.24666666666666667,0.30333333333333334,0.17491648815323876,0.15103519762359272,0.19681276169193201,0.0,0.0,751.85,300,20 | |
| 15 | +A5|closed|qwen3b-llama3b,2,0.29333333333333333,0.26666666666666666,0.3250833333333332,0.20158980090603484,0.18215503297616462,0.22065797308626922,0.0,0.0,952.65,300,20 | |
| 16 | +A5|closed|qwen3b-llama3b,4,0.29,0.26,0.3233333333333333,0.20158980090603484,0.18215503297616462,0.22065797308626922,0.0,0.0,977.35,300,20 | |
| 17 | +A5|closed|qwen3b-llama3b,8,0.29,0.2633333333333333,0.3217499999999999,0.20158980090603484,0.18215503297616462,0.22065797308626922,0.0,0.0,977.35,300,20 | |
| 18 | +A5|closed|qwen3b,1,0.2733333333333333,0.24666666666666667,0.30333333333333334,0.17491648815323876,0.15103519762359272,0.19681276169193201,0.0,0.0,751.85,300,20 | |
| 19 | +A5|closed|qwen3b,2,0.26,0.23333333333333334,0.29,0.17426159197414903,0.148142183355459,0.1991388221983684,0.0,0.0,709.1,300,20 | |
| 20 | +A5|closed|qwen3b,4,0.26666666666666666,0.24333333333333335,0.3,0.17426159197414903,0.148142183355459,0.1991388221983684,0.0,0.0,709.1,300,20 | |
| 21 | +A5|closed|qwen3b,8,0.26666666666666666,0.24333333333333335,0.3,0.17426159197414903,0.148142183355459,0.1991388221983684,0.0,0.0,709.1,300,20 | |
| 22 | +A5|repairable|qwen3b,1,0.2733333333333333,0.24666666666666667,0.30333333333333334,0.17491648815323876,0.15103519762359272,0.19681276169193201,0.0,0.0,751.85,300,20 | |
| 23 | +A5|repairable|qwen3b,2,0.26,0.23,0.29333333333333333,0.18974151525131408,0.1614175785475652,0.21394241158486169,0.0,847.6,710.5,300,20 | |
| 24 | +A5|repairable|qwen3b,4,0.2633333333333333,0.23666666666666666,0.2966666666666667,0.19523779316694684,0.17310645675620093,0.2162458360488423,0.0,2356.1,743.7,300,20 | |
| 25 | +A5|repairable|qwen3b,8,0.2633333333333333,0.23666666666666666,0.2966666666666667,0.19523779316694684,0.17310645675620093,0.2162458360488423,0.0,5373.1,743.7,300,20 | |
modified
results/tables/E5_core_fanin.csv
+50 −50
@@ -1,51 +1,51 @@ | ||
| 1 | 1 | condition,qtype,quality,lo,hi,n,payload_bytes_median,fetched_bytes_mean |
| 2 | −cache_concat_negative_control|k=2,aggregation,0.0,0.0,0.0,13,87035904.0,0.0 | |
| 3 | −cache_concat_negative_control|k=2,multi_hop,0.7307692307692307,0.5769230769230769,0.8846153846153846,26,87035904.0,0.0 | |
| 4 | −cache_concat_negative_control|k=2,revision,0.5,0.3076923076923077,0.6538461538461539,26,87035904.0,0.0 | |
| 5 | −cache_concat_negative_control|k=2,temporal,0.6153846153846154,0.34423076923077006,0.8461538461538461,13,87035904.0,0.0 | |
| 6 | −cache_concat_negative_control|k=2,unanswerable,1.0,1.0,1.0,26,87035904.0,0.0 | |
| 7 | −cache_concat_negative_control|k=4,aggregation,0.0,0.0,0.0,12,164081664.0,0.0 | |
| 8 | −cache_concat_negative_control|k=4,multi_hop,0.5833333333333334,0.3947916666666671,0.75,24,164081664.0,0.0 | |
| 9 | −cache_concat_negative_control|k=4,revision,0.25,0.125,0.375,24,164081664.0,0.0 | |
| 10 | −cache_concat_negative_control|k=4,temporal,0.4166666666666667,0.16666666666666666,0.6666666666666666,12,164081664.0,0.0 | |
| 11 | −cache_concat_negative_control|k=4,unanswerable,0.9583333333333334,0.875,1.0,24,164081664.0,0.0 | |
| 12 | −concat_A4|k=2,aggregation,0.0,0.0,0.0,13,2568.0,0.0 | |
| 13 | −concat_A4|k=2,multi_hop,0.9230769230769231,0.8076923076923077,1.0,26,2568.0,0.0 | |
| 14 | −concat_A4|k=2,revision,0.5769230769230769,0.38461538461538464,0.7692307692307693,26,2568.0,0.0 | |
| 15 | −concat_A4|k=2,temporal,0.6923076923076923,0.46153846153846156,0.9230769230769231,13,2568.0,0.0 | |
| 16 | −concat_A4|k=2,unanswerable,1.0,1.0,1.0,26,2568.0,0.0 | |
| 17 | −concat_A4|k=4,aggregation,0.0,0.0,0.0,12,6079.0,0.0 | |
| 18 | −concat_A4|k=4,multi_hop,0.9583333333333334,0.875,1.0,24,6079.0,0.0 | |
| 19 | −concat_A4|k=4,revision,0.7083333333333334,0.5416666666666666,0.875,24,6079.0,0.0 | |
| 20 | −concat_A4|k=4,temporal,0.75,0.5,1.0,12,6079.0,0.0 | |
| 21 | −concat_A4|k=4,unanswerable,1.0,1.0,1.0,24,6079.0,0.0 | |
| 22 | −full_context|k=2,aggregation,0.0,0.0,0.0,13,8557.0,0.0 | |
| 23 | −full_context|k=2,multi_hop,0.9615384615384616,0.8846153846153846,1.0,26,8557.0,0.0 | |
| 24 | −full_context|k=2,revision,0.6153846153846154,0.46153846153846156,0.7692307692307693,26,8557.0,0.0 | |
| 25 | −full_context|k=2,temporal,0.6923076923076923,0.46153846153846156,0.9230769230769231,13,8557.0,0.0 | |
| 26 | −full_context|k=2,unanswerable,1.0,1.0,1.0,26,8557.0,0.0 | |
| 27 | −full_context|k=4,aggregation,0.0,0.0,0.0,13,9061.0,0.0 | |
| 28 | −full_context|k=4,multi_hop,0.9615384615384616,0.8846153846153846,1.0,26,9061.0,0.0 | |
| 29 | −full_context|k=4,revision,0.6538461538461539,0.5,0.8076923076923077,26,9061.0,0.0 | |
| 30 | −full_context|k=4,temporal,0.5384615384615384,0.3076923076923077,0.7692307692307693,13,9061.0,0.0 | |
| 31 | −full_context|k=4,unanswerable,1.0,1.0,1.0,26,9061.0,0.0 | |
| 32 | −merge_A5|k=2,aggregation,0.0,0.0,0.0,13,1540.0,0.0 | |
| 33 | −merge_A5|k=2,multi_hop,0.23076923076923078,0.11538461538461539,0.366346153846153,26,1540.0,0.0 | |
| 34 | −merge_A5|k=2,revision,0.19230769230769232,0.07692307692307693,0.34615384615384615,26,1540.0,0.0 | |
| 35 | −merge_A5|k=2,temporal,0.46153846153846156,0.23076923076923078,0.732692307692306,13,1540.0,0.0 | |
| 36 | −merge_A5|k=2,unanswerable,1.0,1.0,1.0,26,1540.0,0.0 | |
| 37 | −merge_A5|k=4,aggregation,0.0,0.0,0.0,12,2827.0,0.0 | |
| 38 | −merge_A5|k=4,multi_hop,0.3333333333333333,0.125,0.5833333333333334,24,2827.0,0.0 | |
| 39 | −merge_A5|k=4,revision,0.5,0.375,0.625,24,2827.0,0.0 | |
| 40 | −merge_A5|k=4,temporal,0.3333333333333333,0.08333333333333333,0.5833333333333334,12,2827.0,0.0 | |
| 41 | −merge_A5|k=4,unanswerable,1.0,1.0,1.0,24,2827.0,0.0 | |
| 42 | −shared_memory_A6|k=2,aggregation,0.0,0.0,0.0,13,3029.0,1414.1538461538462 | |
| 43 | −shared_memory_A6|k=2,multi_hop,0.4230769230769231,0.23076923076923078,0.5769230769230769,26,3012.5,1381.6538461538462 | |
| 44 | −shared_memory_A6|k=2,revision,0.4230769230769231,0.19230769230769232,0.6740384615384607,26,2993.0,1383.8076923076924 | |
| 45 | −shared_memory_A6|k=2,temporal,0.46153846153846156,0.23076923076923078,0.6923076923076923,13,2993.0,1369.7692307692307 | |
| 46 | −shared_memory_A6|k=2,unanswerable,1.0,1.0,1.0,26,2993.0,1388.7692307692307 | |
| 47 | −shared_memory_A6|k=4,aggregation,0.0,0.0,0.0,12,6531.0,3424.0833333333335 | |
| 48 | −shared_memory_A6|k=4,multi_hop,0.625,0.4166666666666667,0.7916666666666666,24,6382.5,3310.5 | |
| 49 | −shared_memory_A6|k=4,revision,0.7916666666666666,0.625,0.9583333333333334,24,6525.5,3413.2083333333335 | |
| 50 | −shared_memory_A6|k=4,temporal,0.4166666666666667,0.16666666666666666,0.7104166666666647,12,6369.0,3278.4166666666665 | |
| 51 | −shared_memory_A6|k=4,unanswerable,1.0,1.0,1.0,24,6490.0,3377.9583333333335 | |
| 2 | +cache_concat_negative_control|k=2,aggregation,0.0,0.0,0.0,20,159418368.0,0.0 | |
| 3 | +cache_concat_negative_control|k=2,multi_hop,0.7,0.575,0.825,40,159418368.0,0.0 | |
| 4 | +cache_concat_negative_control|k=2,revision,0.5,0.35,0.65,40,159418368.0,0.0 | |
| 5 | +cache_concat_negative_control|k=2,temporal,0.55,0.35,0.75,20,159418368.0,0.0 | |
| 6 | +cache_concat_negative_control|k=2,unanswerable,1.0,1.0,1.0,40,159418368.0,0.0 | |
| 7 | +cache_concat_negative_control|k=4,aggregation,0.0,0.0,0.0,20,166496256.0,0.0 | |
| 8 | +cache_concat_negative_control|k=4,multi_hop,0.525,0.4,0.675,40,166496256.0,0.0 | |
| 9 | +cache_concat_negative_control|k=4,revision,0.25,0.125,0.4,40,166496256.0,0.0 | |
| 10 | +cache_concat_negative_control|k=4,temporal,0.4,0.2,0.6,20,166496256.0,0.0 | |
| 11 | +cache_concat_negative_control|k=4,unanswerable,0.975,0.9118750000000003,1.0,40,166496256.0,0.0 | |
| 12 | +concat_A4|k=2,aggregation,0.0,0.0,0.0,20,2585.0,0.0 | |
| 13 | +concat_A4|k=2,multi_hop,0.925,0.85,0.9881249999999995,40,2585.0,0.0 | |
| 14 | +concat_A4|k=2,revision,0.7,0.55,0.85,40,2585.0,0.0 | |
| 15 | +concat_A4|k=2,temporal,0.6,0.35,0.8,20,2585.0,0.0 | |
| 16 | +concat_A4|k=2,unanswerable,1.0,1.0,1.0,40,2585.0,0.0 | |
| 17 | +concat_A4|k=4,aggregation,0.0,0.0,0.0,20,6019.5,0.0 | |
| 18 | +concat_A4|k=4,multi_hop,0.925,0.85,1.0,40,6019.5,0.0 | |
| 19 | +concat_A4|k=4,revision,0.65,0.5,0.8,40,6019.5,0.0 | |
| 20 | +concat_A4|k=4,temporal,0.65,0.45,0.85,20,6019.5,0.0 | |
| 21 | +concat_A4|k=4,unanswerable,1.0,1.0,1.0,40,6019.5,0.0 | |
| 22 | +full_context|k=2,aggregation,0.0,0.0,0.0,20,19305.5,0.0 | |
| 23 | +full_context|k=2,multi_hop,0.975,0.925,1.0,40,19305.5,0.0 | |
| 24 | +full_context|k=2,revision,0.6,0.5,0.7131249999999993,40,19305.5,0.0 | |
| 25 | +full_context|k=2,temporal,0.7,0.5,0.9,20,19305.5,0.0 | |
| 26 | +full_context|k=2,unanswerable,1.0,1.0,1.0,40,19305.5,0.0 | |
| 27 | +full_context|k=4,aggregation,0.0,0.0,0.0,20,19809.5,0.0 | |
| 28 | +full_context|k=4,multi_hop,0.95,0.875,1.0,40,19809.5,0.0 | |
| 29 | +full_context|k=4,revision,0.625,0.5,0.75,40,19809.5,0.0 | |
| 30 | +full_context|k=4,temporal,0.5,0.3,0.75,20,19809.5,0.0 | |
| 31 | +full_context|k=4,unanswerable,1.0,1.0,1.0,40,19809.5,0.0 | |
| 32 | +merge_A5|k=2,aggregation,0.0,0.0,0.0,20,1518.0,0.0 | |
| 33 | +merge_A5|k=2,multi_hop,0.225,0.125,0.35,40,1518.0,0.0 | |
| 34 | +merge_A5|k=2,revision,0.15,0.05,0.25,40,1518.0,0.0 | |
| 35 | +merge_A5|k=2,temporal,0.55,0.35,0.8,20,1518.0,0.0 | |
| 36 | +merge_A5|k=2,unanswerable,1.0,1.0,1.0,40,1518.0,0.0 | |
| 37 | +merge_A5|k=4,aggregation,0.0,0.0,0.0,20,2933.5,0.0 | |
| 38 | +merge_A5|k=4,multi_hop,0.325,0.175,0.475,40,2933.5,0.0 | |
| 39 | +merge_A5|k=4,revision,0.45,0.35,0.55,40,2933.5,0.0 | |
| 40 | +merge_A5|k=4,temporal,0.45,0.25,0.65,20,2933.5,0.0 | |
| 41 | +merge_A5|k=4,unanswerable,0.975,0.925,1.0,40,2933.5,0.0 | |
| 42 | +shared_memory_A6|k=2,aggregation,0.0,0.0,0.0,20,2985.5,1425.8 | |
| 43 | +shared_memory_A6|k=2,multi_hop,0.375,0.225,0.525,40,2967.5,1393.75 | |
| 44 | +shared_memory_A6|k=2,revision,0.45,0.3,0.625,40,2967.5,1398.125 | |
| 45 | +shared_memory_A6|k=2,temporal,0.35,0.2,0.55,20,2964.0,1386.25 | |
| 46 | +shared_memory_A6|k=2,unanswerable,1.0,1.0,1.0,40,2967.5,1401.5 | |
| 47 | +shared_memory_A6|k=4,aggregation,0.0,0.0,0.0,20,6438.5,3345.15 | |
| 48 | +shared_memory_A6|k=4,multi_hop,0.6,0.45,0.75,40,6375.5,3236.6 | |
| 49 | +shared_memory_A6|k=4,revision,0.675,0.5,0.85,40,6424.5,3333.3 | |
| 50 | +shared_memory_A6|k=4,temporal,0.45,0.25,0.65,20,6338.0,3210.75 | |
| 51 | +shared_memory_A6|k=4,unanswerable,1.0,1.0,1.0,40,6396.0,3295.975 | |
modified
runs/raw/E1_core.jsonl
+206 −0
@@ -13278,3 +13278,209 @@ | ||
| 13278 | 13278 | {"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "84bbaf2a21d6dfecb8456f19", "attempt_id": "ad950087d4ae", "run_group_id": "E1_core:B5|keep_frac=0.25|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5f903477abec1bb5d55c3fdb62f0e7cdaa6e271a6ce76c4c24f2aed85f54972d", "git_commit": null, "timestamp_utc": "2026-10-30T08:15:52.136967Z", "task_family": "exec", "document_id": "exec_00240_2000", "document_hash": "4c3927b8378a2b949e85371101d959a0adebcbe41a2d39f239aae883de382e19", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00240_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 6713603080}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "blind", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1833, "keep": 458, "window_tokens": 19, "compress_ms": 125.84658397827297}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1773, "source_tokens_receiver": 1773, "query_tokens": 45, "message_tokens": 1833, "message_utf8_bytes": 7797, "cache_tensor_bytes": 52527104, "serialized_payload_bytes": 52540027, "side_information_bytes": 12923, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 140.92112495563924, "doc_prefill_ms": 755.7172500528395, "compress_ms": 126.0839580791071, "serialize_ms": 14.624499948695302, "load_ms": 10.735749965533614, "receiver_prefill_ms": 0.0, "query_prefill_ms": 103.52437500841916, "ttft_ms": 103.52437500841916, "decode_ms": 2015.076957992278}, "total_wall_ms": 2131.282207905315, "ttft_ms": 103.52437500841916, "input_usage": {"receiver_prefix_tokens": 1833, "dense_cache_bytes": 210223104, "query_tokens": 45}, "output_usage": {"output_tokens": 70}, "provider_cached_usage": null, "process_memory": 4553031680, "backend_memory": {"mlx_active_bytes": 6779663368, "mlx_peak_bytes": 6849033452, "mlx_cache_bytes": 13443453829, "process_rss_bytes": 4553031680}, "peak_prefill_memory": 7114248584, "peak_decode_memory": 6849033452, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n total = 0\n for row in rows:\n if row['region'] != 'Nord':\n if row['units'] >= 3 and not row['returned']:\n total += round((row['revenue'] - row['tax']), 1)\n return total\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00240_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "5907933544f257f57e41fadb2827662a780493ad8e442fa27efe35d6d32505f5", "output_hash": "aa8d4725e560d4c26ae00620d85317c9bb6483e7b7e31337cdf63bc5721b6bb9"} |
| 13279 | 13279 | {"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "73bbd85f92bf3017ceda8b93", "attempt_id": "3d7da555db3f", "run_group_id": "E1_core:B6|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5f903477abec1bb5d55c3fdb62f0e7cdaa6e271a6ce76c4c24f2aed85f54972d", "git_commit": null, "timestamp_utc": "2026-10-30T08:15:54.319962Z", "task_family": "exec", "document_id": "exec_00240_2000", "document_hash": "4c3927b8378a2b949e85371101d959a0adebcbe41a2d39f239aae883de382e19", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00240_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 6660387848}, "weight_precision": "bf16", "method_id": "B6", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "pyramid", "keep_frac": 0.25, "T": 1833, "keep": 458, "window_tokens": 45, "compress_ms": 237.40212502889335}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1773, "source_tokens_receiver": 1773, "query_tokens": 45, "message_tokens": 1833, "message_utf8_bytes": 7797, "cache_tensor_bytes": 52527104, "serialized_payload_bytes": 52539987, "side_information_bytes": 12883, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 255.0340419402346, "doc_prefill_ms": 755.7172500528395, "compress_ms": 239.0654580667615, "serialize_ms": 15.727957943454385, "load_ms": 1.3509170385077596, "receiver_prefill_ms": 0.0, "query_prefill_ms": 775.9203750174493, "ttft_ms": 775.9203750174493, "decode_ms": 2776.375083019957}, "total_wall_ms": 3810.6947500491515, "ttft_ms": 775.9203750174493, "input_usage": {"receiver_prefix_tokens": 1833, "dense_cache_bytes": 210223104, "query_tokens": 45}, "output_usage": {"output_tokens": 95}, "provider_cached_usage": null, "process_memory": 4607213568, "backend_memory": {"mlx_active_bytes": 6782727176, "mlx_peak_bytes": 6846201008, "mlx_cache_bytes": 13776941673, "process_rss_bytes": 4607213568}, "peak_prefill_memory": 7114248584, "peak_decode_memory": 6846201008, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['region'] != 'Brasil' and r['shipped_days'] > 0 and r['shipped_days'] <= 30 and r['units'] >= 3:\n total += r['units'] * (r['price'] - r['price_tax']) / 100\n return round(total, 1)\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00240_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "cbc5f4cdd11689900f722fe2822fc2a4a031a0cc67275e5a2436979af1406516", "output_hash": "9634503ef64bad26ab9c39f04ebe241d55fc598b541570c1090e88839a2a9778"} |
| 13280 | 13280 | {"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "bed146b144b2aae79fc28597", "attempt_id": "184a0271c61a", "run_group_id": "E1_core:B9|bits=8|keep_frac=0.25|policy=attention|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5f903477abec1bb5d55c3fdb62f0e7cdaa6e271a6ce76c4c24f2aed85f54972d", "git_commit": null, "timestamp_utc": "2026-10-30T08:15:58.187694Z", "task_family": "exec", "document_id": "exec_00240_2000", "document_hash": "4c3927b8378a2b949e85371101d959a0adebcbe41a2d39f239aae883de382e19", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00240_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 6660387848}, "weight_precision": "bf16", "method_id": "B9", "implementation_fidelity": "custom", "compression_config": {"keep_frac": 0.25, "bits": 8, "access": "aware", "policy": "attention", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1833, "keep": 458, "window_tokens": 45, "compress_ms": 215.65874991938472, "bits": 8}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1773, "source_tokens_receiver": 1773, "query_tokens": 45, "message_tokens": 1833, "message_utf8_bytes": 7797, "cache_tensor_bytes": 27905024, "serialized_payload_bytes": 27931808, "side_information_bytes": 26784, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 240.00837502535433, "doc_prefill_ms": 755.7172500528395, "compress_ms": 227.48991602566093, "serialize_ms": 11.965167010203004, "load_ms": 2.515166997909546, "receiver_prefill_ms": 0.0, "query_prefill_ms": 80.02966595813632, "ttft_ms": 80.02966595813632, "decode_ms": 2747.8094580583274}, "total_wall_ms": 3072.6914999540895, "ttft_ms": 80.02966595813632, "input_usage": {"receiver_prefix_tokens": 1833, "dense_cache_bytes": 210223104, "query_tokens": 45}, "output_usage": {"output_tokens": 87}, "provider_cached_usage": null, "process_memory": 4635295744, "backend_memory": {"mlx_active_bytes": 6726884232, "mlx_peak_bytes": 6801893764, "mlx_cache_bytes": 14017897833, "process_rss_bytes": 4635295744}, "peak_prefill_memory": 7114248584, "peak_decode_memory": 6801893764, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['region'] != 'Nordic' and r['shipped_days'] > 0 and r['units'] >= 3:\n total += r['units'] * (r['price'] - r['price'] * 0.05)\n return round(total, 1)\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00240_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "8917f1ddbd32af3864d926b03ec5386344e9aee78fcfab547010d24fc7396973", "output_hash": "ac4952f97dcca3f9355ebcb56c3f776365130c6b0263709fda5d0302bf9e472e"} |
| 13281 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "e693c2a0f8067f34fe7c153b", "attempt_id": "fddc12edd77b", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:16.091202Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425501000}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.29854227405247813, "origin_tokens": 1715, "compressed_tokens": 622, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1715, "source_tokens_receiver": 1715, "query_tokens": 720, "message_tokens": 622, "message_utf8_bytes": 2148, "cache_tensor_bytes": null, "serialized_payload_bytes": 2148, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2021.651333081536, "decode_payload_ms": 0.0, "receiver_prefill_ms": 88.24825007468462, "ttft_ms": 14.05166694894433, "decode_ms": 108.22170891333371}, "total_wall_ms": 217.37012499943376, "ttft_ms": 14.05166694894433, "input_usage": {"receiver_prompt_tokens": 720}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 9828892672, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6927572312, "mlx_cache_bytes": 518107816, "process_rss_bytes": 9828892672}, "peak_prefill_memory": null, "peak_decode_memory": 6927572312, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "ZL-78K-5065", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "2b088774b4fab3483bb5bf185dc51a3428d262ac8df4af84d1932ad2c6c28590", "output_hash": "2a568d613468fe9e25fd3ab03aa2744ae45702a47a3665ea5aa63251d8bc749c"} | |
| 13282 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "6ab0d61b023977a3aab86d0c", "attempt_id": "f1b3ef052f28", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:16.331245Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.29854227405247813, "origin_tokens": 1715, "compressed_tokens": 622, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1715, "source_tokens_receiver": 1715, "query_tokens": 725, "message_tokens": 622, "message_utf8_bytes": 2148, "cache_tensor_bytes": null, "serialized_payload_bytes": 2148, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2021.651333081536, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.62362489383668, "ttft_ms": 13.380417018197477, "decode_ms": 200.93450008425862}, "total_wall_ms": 297.28458309546113, "ttft_ms": 13.380417018197477, "input_usage": {"receiver_prompt_tokens": 725}, "output_usage": {"output_tokens": 15}, "provider_cached_usage": null, "process_memory": 9829154816, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6930562984, "mlx_cache_bytes": 950091256, "process_rss_bytes": 9829154816}, "peak_prefill_memory": null, "peak_decode_memory": 6930562984, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Wendra-11, Lot 409-H, Senneterre.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.25}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "2b088774b4fab3483bb5bf185dc51a3428d262ac8df4af84d1932ad2c6c28590", "output_hash": "b64a2624a8239548dca756e390c89e0dbb0116a880ce2ef82839838aae5cb6d6"} | |
| 13283 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "05ecf4710ef1ee8f643251a7", "attempt_id": "f90017ee15f8", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:16.650544Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.29854227405247813, "origin_tokens": 1715, "compressed_tokens": 622, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1715, "source_tokens_receiver": 1715, "query_tokens": 724, "message_tokens": 622, "message_utf8_bytes": 2148, "cache_tensor_bytes": null, "serialized_payload_bytes": 2148, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2021.651333081536, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.32379199378192, "ttft_ms": 13.422250049188733, "decode_ms": 66.910499939695}, "total_wall_ms": 162.95937495306134, "ttft_ms": 13.422250049188733, "input_usage": {"receiver_prompt_tokens": 724}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 9829171200, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6930562984, "mlx_cache_bytes": 950091256, "process_rss_bytes": 9829171200}, "peak_prefill_memory": null, "peak_decode_memory": 6930562984, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "53. 8485", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "2b088774b4fab3483bb5bf185dc51a3428d262ac8df4af84d1932ad2c6c28590", "output_hash": "b6a830c876988e318c117bbe98ba0308462152115e9e345542ef4f0111fde741"} | |
| 13284 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "b90cf31091d58cc6c352621c", "attempt_id": "46b9a28c6dcf", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:16.835584Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.29854227405247813, "origin_tokens": 1715, "compressed_tokens": 622, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1715, "source_tokens_receiver": 1715, "query_tokens": 722, "message_tokens": 622, "message_utf8_bytes": 2148, "cache_tensor_bytes": null, "serialized_payload_bytes": 2148, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2021.651333081536, "decode_payload_ms": 0.0, "receiver_prefill_ms": 80.60204098001122, "ttft_ms": 13.43433407600969, "decode_ms": 93.45495898742229}, "total_wall_ms": 188.7822919525206, "ttft_ms": 13.43433407600969, "input_usage": {"receiver_prompt_tokens": 722}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 9829171200, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6906281884, "mlx_cache_bytes": 1081540088, "process_rss_bytes": 9829171200}, "peak_prefill_memory": null, "peak_decode_memory": 6906281884, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lorcan Okonkwo", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "2b088774b4fab3483bb5bf185dc51a3428d262ac8df4af84d1932ad2c6c28590", "output_hash": "0899b5427048f8ade3a2c73afe103e6432ff382fe37cae3efa13bf39f3ca8326"} | |
| 13285 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "98034bd4bd3d766b537260fc", "attempt_id": "c03001396ee5", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:17.045634Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.29854227405247813, "origin_tokens": 1715, "compressed_tokens": 622, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1715, "source_tokens_receiver": 1715, "query_tokens": 729, "message_tokens": 622, "message_utf8_bytes": 2148, "cache_tensor_bytes": null, "serialized_payload_bytes": 2148, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2021.651333081536, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.3810839317739, "ttft_ms": 13.53300001937896, "decode_ms": 67.80225003603846}, "total_wall_ms": 164.08870904706419, "ttft_ms": 13.53300001937896, "input_usage": {"receiver_prompt_tokens": 729}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 9829203968, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6932381624, "mlx_cache_bytes": 1488570712, "process_rss_bytes": 9829203968}, "peak_prefill_memory": null, "peak_decode_memory": 6932381624, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2,358,405", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "2b088774b4fab3483bb5bf185dc51a3428d262ac8df4af84d1932ad2c6c28590", "output_hash": "0cdd29b7d6e8daeeac8d4b1ad42aae1dd4c08db99789b82ac0f8f9b5bb149685"} | |
| 13286 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "605c22f78d8ca17ec56afe0a", "attempt_id": "7fad51d65edc", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:17.664264Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09128186842574434, "origin_tokens": 5609, "compressed_tokens": 595, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5609, "source_tokens_receiver": 5609, "query_tokens": 693, "message_tokens": 595, "message_utf8_bytes": 3080, "cache_tensor_bytes": null, "serialized_payload_bytes": 3080, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 428.2587090274319, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.21866697911173, "ttft_ms": 13.565208064392209, "decode_ms": 67.14649999048561}, "total_wall_ms": 163.3261670358479, "ttft_ms": 13.565208064392209, "input_usage": {"receiver_prompt_tokens": 693}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 9831825408, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6912016168, "mlx_cache_bytes": 502105128, "process_rss_bytes": 9831825408}, "peak_prefill_memory": null, "peak_decode_memory": 6912016168, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Eshfel-2", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "53e8f3e5d23af373057d54cfb7eb07dab60c36bdc80bc577e5159b51478ddd19", "output_hash": "3123ff87d1ad9b263e28f2fddd4604886e24c865be647de72d7f2b49c4adf9e4"} | |
| 13287 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "50af456617f12dfe766bbe43", "attempt_id": "4ad249c86321", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:17.855527Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09128186842574434, "origin_tokens": 5609, "compressed_tokens": 595, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5609, "source_tokens_receiver": 5609, "query_tokens": 699, "message_tokens": 595, "message_utf8_bytes": 3080, "cache_tensor_bytes": null, "serialized_payload_bytes": 3080, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 428.2587090274319, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.91945892758667, "ttft_ms": 13.558999984525144, "decode_ms": 136.006208951585}, "total_wall_ms": 232.87962505128235, "ttft_ms": 13.558999984525144, "input_usage": {"receiver_prompt_tokens": 699}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 9831890944, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6915391296, "mlx_cache_bytes": 918490896, "process_rss_bytes": 9831890944}, "peak_prefill_memory": null, "peak_decode_memory": 6915391296, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 136-T, Val-d'Or.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "53e8f3e5d23af373057d54cfb7eb07dab60c36bdc80bc577e5159b51478ddd19", "output_hash": "5f0de62750d455586d1f0186109d27f65fbad08e214a81a62a809ae08099760e"} | |
| 13288 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "9d14b2cf784bbdf8dcb64f75", "attempt_id": "6ece51b460b2", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:18.115807Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09128186842574434, "origin_tokens": 5609, "compressed_tokens": 595, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5609, "source_tokens_receiver": 5609, "query_tokens": 698, "message_tokens": 595, "message_utf8_bytes": 3080, "cache_tensor_bytes": null, "serialized_payload_bytes": 3080, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 428.2587090274319, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.34458307176828, "ttft_ms": 13.529708026908338, "decode_ms": 13.409332954324782}, "total_wall_ms": 109.71012490335852, "ttft_ms": 13.529708026908338, "input_usage": {"receiver_prompt_tokens": 698}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9831907328, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6915391296, "mlx_cache_bytes": 918490896, "process_rss_bytes": 9831907328}, "peak_prefill_memory": null, "peak_decode_memory": 6915391296, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "53e8f3e5d23af373057d54cfb7eb07dab60c36bdc80bc577e5159b51478ddd19", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13289 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "9eceb89cf5082e75d42b9545", "attempt_id": "666beb731aed", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:18.253483Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09128186842574434, "origin_tokens": 5609, "compressed_tokens": 595, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5609, "source_tokens_receiver": 5609, "query_tokens": 694, "message_tokens": 595, "message_utf8_bytes": 3080, "cache_tensor_bytes": null, "serialized_payload_bytes": 3080, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 428.2587090274319, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.72704197932035, "ttft_ms": 13.460957910865545, "decode_ms": 40.41708307340741}, "total_wall_ms": 136.9502500165254, "ttft_ms": 13.460957910865545, "input_usage": {"receiver_prompt_tokens": 694}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 9831923712, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6912393024, "mlx_cache_bytes": 1122963216, "process_rss_bytes": 9831923712}, "peak_prefill_memory": null, "peak_decode_memory": 6912393024, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Mbeki", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.6666666666666666}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "53e8f3e5d23af373057d54cfb7eb07dab60c36bdc80bc577e5159b51478ddd19", "output_hash": "8fa68c7f01cff2cf9478768f28ec2ef832ba887f090823b25abbadc032d4ebce"} | |
| 13290 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "e7de4a26a9a8c9f496995df0", "attempt_id": "047eeb8e7f35", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:18.418418Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09128186842574434, "origin_tokens": 5609, "compressed_tokens": 595, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5609, "source_tokens_receiver": 5609, "query_tokens": 704, "message_tokens": 595, "message_utf8_bytes": 3080, "cache_tensor_bytes": null, "serialized_payload_bytes": 3080, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 428.2587090274319, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.83562499471009, "ttft_ms": 13.709292048588395, "decode_ms": 14.347999938763678}, "total_wall_ms": 111.34775006212294, "ttft_ms": 13.709292048588395, "input_usage": {"receiver_prompt_tokens": 704}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9831923712, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6918291284, "mlx_cache_bytes": 1516378636, "process_rss_bytes": 9831923712}, "peak_prefill_memory": null, "peak_decode_memory": 6918291284, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "53e8f3e5d23af373057d54cfb7eb07dab60c36bdc80bc577e5159b51478ddd19", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13291 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "7fcd4596e51f6e27e5f295dc", "attempt_id": "d8090479493f", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:19.326589Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.047926612374801086, "origin_tokens": 10683, "compressed_tokens": 543, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10683, "source_tokens_receiver": 10683, "query_tokens": 641, "message_tokens": 543, "message_utf8_bytes": 2519, "cache_tensor_bytes": null, "serialized_payload_bytes": 2519, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 765.0792500935495, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.37445901148021, "ttft_ms": 14.16324998717755, "decode_ms": 13.72533303219825}, "total_wall_ms": 106.66808299720287, "ttft_ms": 14.16324998717755, "input_usage": {"receiver_prompt_tokens": 641}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9836396544, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6881377880, "mlx_cache_bytes": 470614872, "process_rss_bytes": 9836396544}, "peak_prefill_memory": null, "peak_decode_memory": 6881377880, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "dd0973fbb70f6df409f5bddccc13f27efdc4008501ac5b81c6915723f28b5e32", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13292 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "0693dd09f5ebb18189ee11ea", "attempt_id": "4fc94383b03f", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:19.468329Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.047926612374801086, "origin_tokens": 10683, "compressed_tokens": 543, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10683, "source_tokens_receiver": 10683, "query_tokens": 649, "message_tokens": 543, "message_utf8_bytes": 2519, "cache_tensor_bytes": null, "serialized_payload_bytes": 2519, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 765.0792500935495, "decode_payload_ms": 0.0, "receiver_prefill_ms": 78.79649999085814, "ttft_ms": 14.618832967244089, "decode_ms": 14.192749978974462}, "total_wall_ms": 108.97004196885973, "ttft_ms": 14.618832967244089, "input_usage": {"receiver_prompt_tokens": 649}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9836494848, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6886014584, "mlx_cache_bytes": 856804728, "process_rss_bytes": 9836494848}, "peak_prefill_memory": null, "peak_decode_memory": 6886014584, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "dd0973fbb70f6df409f5bddccc13f27efdc4008501ac5b81c6915723f28b5e32", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13293 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "dd0a3e2af6e404dc22c926d6", "attempt_id": "46bc2ec397b0", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:19.611597Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.047926612374801086, "origin_tokens": 10683, "compressed_tokens": 543, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10683, "source_tokens_receiver": 10683, "query_tokens": 648, "message_tokens": 543, "message_utf8_bytes": 2519, "cache_tensor_bytes": null, "serialized_payload_bytes": 2519, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 765.0792500935495, "decode_payload_ms": 0.0, "receiver_prefill_ms": 78.71583302039653, "ttft_ms": 13.85804102756083, "decode_ms": 14.070832985453308}, "total_wall_ms": 108.04883297532797, "ttft_ms": 13.85804102756083, "input_usage": {"receiver_prompt_tokens": 648}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9836544000, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6886014584, "mlx_cache_bytes": 856804728, "process_rss_bytes": 9836544000}, "peak_prefill_memory": null, "peak_decode_memory": 6886014584, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "dd0973fbb70f6df409f5bddccc13f27efdc4008501ac5b81c6915723f28b5e32", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13294 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "74f5483eb840b87c95033508", "attempt_id": "cc88581024fd", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:19.754778Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.047926612374801086, "origin_tokens": 10683, "compressed_tokens": 543, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10683, "source_tokens_receiver": 10683, "query_tokens": 642, "message_tokens": 543, "message_utf8_bytes": 2519, "cache_tensor_bytes": null, "serialized_payload_bytes": 2519, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 765.0792500935495, "decode_payload_ms": 0.0, "receiver_prefill_ms": 78.90075002796948, "ttft_ms": 14.335667015984654, "decode_ms": 13.735500047914684}, "total_wall_ms": 108.29170898068696, "ttft_ms": 14.335667015984654, "input_usage": {"receiver_prompt_tokens": 642}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9836544000, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6882754168, "mlx_cache_bytes": 1215729016, "process_rss_bytes": 9836544000}, "peak_prefill_memory": null, "peak_decode_memory": 6882754168, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "dd0973fbb70f6df409f5bddccc13f27efdc4008501ac5b81c6915723f28b5e32", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13295 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "70d9495af2eb6f400ba5104c", "attempt_id": "9e70072bfb75", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:19.899888Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.047926612374801086, "origin_tokens": 10683, "compressed_tokens": 543, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10683, "source_tokens_receiver": 10683, "query_tokens": 653, "message_tokens": 543, "message_utf8_bytes": 2519, "cache_tensor_bytes": null, "serialized_payload_bytes": 2519, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 765.0792500935495, "decode_payload_ms": 0.0, "receiver_prefill_ms": 79.0116669377312, "ttft_ms": 13.695917092263699, "decode_ms": 13.3534170454368}, "total_wall_ms": 107.36233298666775, "ttft_ms": 13.695917092263699, "input_usage": {"receiver_prompt_tokens": 653}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9836560384, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6888832648, "mlx_cache_bytes": 1604802472, "process_rss_bytes": 9836560384}, "peak_prefill_memory": null, "peak_decode_memory": 6888832648, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "dd0973fbb70f6df409f5bddccc13f27efdc4008501ac5b81c6915723f28b5e32", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13296 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "039ed125b8e59d05e87a148e", "attempt_id": "3401834bbe22", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:20.177592Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.29732868757259, "origin_tokens": 1722, "compressed_tokens": 613, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1722, "source_tokens_receiver": 1722, "query_tokens": 712, "message_tokens": 613, "message_utf8_bytes": 2275, "cache_tensor_bytes": null, "serialized_payload_bytes": 2275, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 131.26675004605204, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.32204203866422, "ttft_ms": 13.604249921627343, "decode_ms": 93.73520803637803}, "total_wall_ms": 189.96008404064924, "ttft_ms": 13.604249921627343, "input_usage": {"receiver_prompt_tokens": 712}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 9836625920, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6922927988, "mlx_cache_bytes": 513328244, "process_rss_bytes": 9836625920}, "peak_prefill_memory": null, "peak_decode_memory": 6922927988, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "GR-79S-5839", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "18a3ac2b35a8e6904db45dcf919ff1c109f97041ccf5c1e3dac0c1d25409bbbb", "output_hash": "720cc40cd69e85e9728f6bea00b17a95ca07eee643e143a131840763958303cd"} | |
| 13297 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "a2c41c0a08ea1e75fada501a", "attempt_id": "ac9f2b7e542d", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:20.389340Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.29732868757259, "origin_tokens": 1722, "compressed_tokens": 613, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1722, "source_tokens_receiver": 1722, "query_tokens": 716, "message_tokens": 613, "message_utf8_bytes": 2275, "cache_tensor_bytes": null, "serialized_payload_bytes": 2275, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 131.26675004605204, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.43654104787856, "ttft_ms": 13.545499998144805, "decode_ms": 133.69549997150898}, "total_wall_ms": 229.93883304297924, "ttft_ms": 13.545499998144805, "input_usage": {"receiver_prompt_tokens": 716}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 9836642304, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6925746052, "mlx_cache_bytes": 940347296, "process_rss_bytes": 9836642304}, "peak_prefill_memory": null, "peak_decode_memory": 6925746052, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 344-B, Brigam-3.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.5714285714285715}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "18a3ac2b35a8e6904db45dcf919ff1c109f97041ccf5c1e3dac0c1d25409bbbb", "output_hash": "0c125cfd8a40ccd96622211c8fcd5fe0c12dc4afe88880a82b2142144b87c9e3"} | |
| 13298 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "330dbe642eb5f98691b1dd22", "attempt_id": "60df7093855f", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:20.640482Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.29732868757259, "origin_tokens": 1722, "compressed_tokens": 613, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1722, "source_tokens_receiver": 1722, "query_tokens": 716, "message_tokens": 613, "message_utf8_bytes": 2275, "cache_tensor_bytes": null, "serialized_payload_bytes": 2275, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 131.26675004605204, "decode_payload_ms": 0.0, "receiver_prefill_ms": 80.5702080251649, "ttft_ms": 13.477666885592043, "decode_ms": 13.66570801474154}, "total_wall_ms": 108.98645897395909, "ttft_ms": 13.477666885592043, "input_usage": {"receiver_prompt_tokens": 716}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9836642304, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6925746052, "mlx_cache_bytes": 940347296, "process_rss_bytes": 9836642304}, "peak_prefill_memory": null, "peak_decode_memory": 6925746052, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "18a3ac2b35a8e6904db45dcf919ff1c109f97041ccf5c1e3dac0c1d25409bbbb", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13299 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "dad77a2764ea90729fc54ba0", "attempt_id": "fdc5d21f147e", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:20.770739Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.29732868757259, "origin_tokens": 1722, "compressed_tokens": 613, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1722, "source_tokens_receiver": 1722, "query_tokens": 711, "message_tokens": 613, "message_utf8_bytes": 2275, "cache_tensor_bytes": null, "serialized_payload_bytes": 2275, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 131.26675004605204, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.16004196926951, "ttft_ms": 13.55504197999835, "decode_ms": 66.9077499769628}, "total_wall_ms": 162.9088749177754, "ttft_ms": 13.55504197999835, "input_usage": {"receiver_prompt_tokens": 711}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 9836642304, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6922927988, "mlx_cache_bytes": 940347296, "process_rss_bytes": 9836642304}, "peak_prefill_memory": null, "peak_decode_memory": 6922927988, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Aurelio Obuya", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "18a3ac2b35a8e6904db45dcf919ff1c109f97041ccf5c1e3dac0c1d25409bbbb", "output_hash": "f1ce4925037312b15b000d239b3674716a85608f05fe592eb101242927ff1f34"} | |
| 13300 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "35e8631c32a66947dd3475ce", "attempt_id": "3261fc1bcbf9", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:20.954641Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.29732868757259, "origin_tokens": 1722, "compressed_tokens": 613, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1722, "source_tokens_receiver": 1722, "query_tokens": 720, "message_tokens": 613, "message_utf8_bytes": 2275, "cache_tensor_bytes": null, "serialized_payload_bytes": 2275, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 131.26675004605204, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.12020895350724, "ttft_ms": 13.62887502182275, "decode_ms": 13.435082975775003}, "total_wall_ms": 109.33791601564735, "ttft_ms": 13.62887502182275, "input_usage": {"receiver_prompt_tokens": 720}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9836642304, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6927564692, "mlx_cache_bytes": 1342708444, "process_rss_bytes": 9836642304}, "peak_prefill_memory": null, "peak_decode_memory": 6927564692, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "18a3ac2b35a8e6904db45dcf919ff1c109f97041ccf5c1e3dac0c1d25409bbbb", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13301 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "b004f341b2d986156d66c2cc", "attempt_id": "941658e7dc53", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:21.497337Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09063551070986015, "origin_tokens": 5649, "compressed_tokens": 606, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5649, "source_tokens_receiver": 5649, "query_tokens": 705, "message_tokens": 606, "message_utf8_bytes": 2961, "cache_tensor_bytes": null, "serialized_payload_bytes": 2961, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 409.0547499945387, "decode_payload_ms": 0.0, "receiver_prefill_ms": 80.09295794181526, "ttft_ms": 13.505958952009678, "decode_ms": 13.382583972997963}, "total_wall_ms": 108.27175003942102, "ttft_ms": 13.505958952009678, "input_usage": {"receiver_prompt_tokens": 705}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9836691456, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6918471512, "mlx_cache_bytes": 508757080, "process_rss_bytes": 9836691456}, "peak_prefill_memory": null, "peak_decode_memory": 6918471512, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "33baf3d7325d6ec03cde3459fca49c82c3b55983c4d0e102a0693e318c073ad0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13302 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "56dd5510ee8b56dfe1103e2a", "attempt_id": "5503db0ad1a4", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:21.632820Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09063551070986015, "origin_tokens": 5649, "compressed_tokens": 606, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5649, "source_tokens_receiver": 5649, "query_tokens": 709, "message_tokens": 606, "message_utf8_bytes": 2961, "cache_tensor_bytes": null, "serialized_payload_bytes": 2961, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 409.0547499945387, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.36358298361301, "ttft_ms": 13.633999973535538, "decode_ms": 13.37166700977832}, "total_wall_ms": 109.7369579365477, "ttft_ms": 13.633999973535538, "input_usage": {"receiver_prompt_tokens": 709}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9836658688, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6921289576, "mlx_cache_bytes": 931204968, "process_rss_bytes": 9836658688}, "peak_prefill_memory": null, "peak_decode_memory": 6921289576, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "33baf3d7325d6ec03cde3459fca49c82c3b55983c4d0e102a0693e318c073ad0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13303 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "d8dcca0ba4203b70bf7c9fb8", "attempt_id": "9a009c2ef02c", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:21.769806Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09063551070986015, "origin_tokens": 5649, "compressed_tokens": 606, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5649, "source_tokens_receiver": 5649, "query_tokens": 709, "message_tokens": 606, "message_utf8_bytes": 2961, "cache_tensor_bytes": null, "serialized_payload_bytes": 2961, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 409.0547499945387, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.12391701433808, "ttft_ms": 13.566958950832486, "decode_ms": 13.396875001490116}, "total_wall_ms": 109.33395894244313, "ttft_ms": 13.566958950832486, "input_usage": {"receiver_prompt_tokens": 709}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9836658688, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6921289576, "mlx_cache_bytes": 931204968, "process_rss_bytes": 9836658688}, "peak_prefill_memory": null, "peak_decode_memory": 6921289576, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "33baf3d7325d6ec03cde3459fca49c82c3b55983c4d0e102a0693e318c073ad0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13304 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "150afc3ea84b785010ef3412", "attempt_id": "1b12feb47089", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:21.905981Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09063551070986015, "origin_tokens": 5649, "compressed_tokens": 606, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5649, "source_tokens_receiver": 5649, "query_tokens": 706, "message_tokens": 606, "message_utf8_bytes": 2961, "cache_tensor_bytes": null, "serialized_payload_bytes": 2961, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 409.0547499945387, "decode_payload_ms": 0.0, "receiver_prefill_ms": 80.9357080142945, "ttft_ms": 13.638250064104795, "decode_ms": 53.30920801497996}, "total_wall_ms": 149.13216698914766, "ttft_ms": 13.638250064104795, "input_usage": {"receiver_prompt_tokens": 706}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 9836658688, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6955450216, "mlx_cache_bytes": 1113231208, "process_rss_bytes": 9836658688}, "peak_prefill_memory": null, "peak_decode_memory": 6955450216, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Mäkelä", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "33baf3d7325d6ec03cde3459fca49c82c3b55983c4d0e102a0693e318c073ad0", "output_hash": "4f2c406c72d386d787e1d5d7b4a55ecd1815ee6e49d88f208969fc2241b58aa2"} | |
| 13305 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "2bfd62f2b0bfbb691a981787", "attempt_id": "28cb45c5a8c2", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:22.081496Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09063551070986015, "origin_tokens": 5649, "compressed_tokens": 606, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5649, "source_tokens_receiver": 5649, "query_tokens": 711, "message_tokens": 606, "message_utf8_bytes": 2961, "cache_tensor_bytes": null, "serialized_payload_bytes": 2961, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 409.0547499945387, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.02945797145367, "ttft_ms": 13.52983305696398, "decode_ms": 40.32929195091128}, "total_wall_ms": 136.1703749280423, "ttft_ms": 13.52983305696398, "input_usage": {"receiver_prompt_tokens": 711}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 9836658688, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6922551152, "mlx_cache_bytes": 1510726272, "process_rss_bytes": 9836658688}, "peak_prefill_memory": null, "peak_decode_memory": 6922551152, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "USD. revised", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "33baf3d7325d6ec03cde3459fca49c82c3b55983c4d0e102a0693e318c073ad0", "output_hash": "71cee772fbcfa578116ceb4d2bf5bf2abd0731459fb1c1abc555c643e9a7f1b2"} | |
| 13306 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "9db43ad67c7d089cf78a5de4", "attempt_id": "ca01365eff0b", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:23.009202Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.04748655166017436, "origin_tokens": 10782, "compressed_tokens": 522, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10782, "source_tokens_receiver": 10782, "query_tokens": 619, "message_tokens": 522, "message_utf8_bytes": 2559, "cache_tensor_bytes": null, "serialized_payload_bytes": 2559, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 760.5764999752864, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.88595799077302, "ttft_ms": 13.516874983906746, "decode_ms": 13.315332937054336}, "total_wall_ms": 103.00029208883643, "ttft_ms": 13.516874983906746, "input_usage": {"receiver_prompt_tokens": 619}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9837002752, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6869024256, "mlx_cache_bytes": 457900800, "process_rss_bytes": 9837002752}, "peak_prefill_memory": null, "peak_decode_memory": 6869024256, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "cca99e503f310df0a1b131a1eb87dc6496a54df89a6b91c41dafbf6d397932e6", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13307 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "d2f90d8a5399cb3e784f30f1", "attempt_id": "3f8787e347ec", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:23.146919Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.04748655166017436, "origin_tokens": 10782, "compressed_tokens": 522, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10782, "source_tokens_receiver": 10782, "query_tokens": 627, "message_tokens": 522, "message_utf8_bytes": 2559, "cache_tensor_bytes": null, "serialized_payload_bytes": 2559, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 760.5764999752864, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.17145795281976, "ttft_ms": 13.402958982624114, "decode_ms": 13.350917026400566}, "total_wall_ms": 103.29599992837757, "ttft_ms": 13.402958982624114, "input_usage": {"receiver_prompt_tokens": 627}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9837035520, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6873660960, "mlx_cache_bytes": 831376584, "process_rss_bytes": 9837035520}, "peak_prefill_memory": null, "peak_decode_memory": 6873660960, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "cca99e503f310df0a1b131a1eb87dc6496a54df89a6b91c41dafbf6d397932e6", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13308 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "ce5380e61d48a6de0b22a7c5", "attempt_id": "1efb31f6d0da", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:23.284010Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.04748655166017436, "origin_tokens": 10782, "compressed_tokens": 522, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10782, "source_tokens_receiver": 10782, "query_tokens": 626, "message_tokens": 522, "message_utf8_bytes": 2559, "cache_tensor_bytes": null, "serialized_payload_bytes": 2559, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 760.5764999752864, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.75908403284848, "ttft_ms": 13.608583016321063, "decode_ms": 13.437416055239737}, "total_wall_ms": 102.95958293136209, "ttft_ms": 13.608583016321063, "input_usage": {"receiver_prompt_tokens": 626}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9837035520, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6873660960, "mlx_cache_bytes": 831376584, "process_rss_bytes": 9837035520}, "peak_prefill_memory": null, "peak_decode_memory": 6873660960, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "cca99e503f310df0a1b131a1eb87dc6496a54df89a6b91c41dafbf6d397932e6", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13309 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "be35247ce47acf316ef1b413", "attempt_id": "d4eb5d26eaa6", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:23.420812Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.04748655166017436, "origin_tokens": 10782, "compressed_tokens": 522, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10782, "source_tokens_receiver": 10782, "query_tokens": 621, "message_tokens": 522, "message_utf8_bytes": 2559, "cache_tensor_bytes": null, "serialized_payload_bytes": 2559, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 760.5764999752864, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.89741596207023, "ttft_ms": 13.512792065739632, "decode_ms": 27.130375034175813}, "total_wall_ms": 119.67762489803135, "ttft_ms": 13.512792065739632, "input_usage": {"receiver_prompt_tokens": 621}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 9837035520, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6870285856, "mlx_cache_bytes": 1178373320, "process_rss_bytes": 9837035520}, "peak_prefill_memory": null, "peak_decode_memory": 6870285856, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Unknown.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "cca99e503f310df0a1b131a1eb87dc6496a54df89a6b91c41dafbf6d397932e6", "output_hash": "9cf9f50925b2a7803c73826a305235d4215dc428721c731072a9f2c0f5d6ae5a"} | |
| 13310 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "7b4b46636fc71ed92a64df0e", "attempt_id": "62a7eff9ff65", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:23.574704Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.04748655166017436, "origin_tokens": 10782, "compressed_tokens": 522, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10782, "source_tokens_receiver": 10782, "query_tokens": 631, "message_tokens": 522, "message_utf8_bytes": 2559, "cache_tensor_bytes": null, "serialized_payload_bytes": 2559, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 760.5764999752864, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.21879195701331, "ttft_ms": 13.592291041277349, "decode_ms": 13.281708001159132}, "total_wall_ms": 103.27895905356854, "ttft_ms": 13.592291041277349, "input_usage": {"receiver_prompt_tokens": 631}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9837035520, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6876184112, "mlx_cache_bytes": 1531139744, "process_rss_bytes": 9837035520}, "peak_prefill_memory": null, "peak_decode_memory": 6876184112, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "cca99e503f310df0a1b131a1eb87dc6496a54df89a6b91c41dafbf6d397932e6", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13311 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "a6d84e8f2040a20e94e0314a", "attempt_id": "e6a15fd85355", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:23.846426Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.29819452533488644, "origin_tokens": 1717, "compressed_tokens": 599, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1717, "source_tokens_receiver": 1717, "query_tokens": 697, "message_tokens": 599, "message_utf8_bytes": 2267, "cache_tensor_bytes": null, "serialized_payload_bytes": 2267, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 131.40666694380343, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.37258398346603, "ttft_ms": 13.665708946064115, "decode_ms": 93.69083296041936}, "total_wall_ms": 189.98687504790723, "ttft_ms": 13.665708946064115, "input_usage": {"receiver_prompt_tokens": 697}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 9837068288, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6913834808, "mlx_cache_bytes": 503989304, "process_rss_bytes": 9837068288}, "peak_prefill_memory": null, "peak_decode_memory": 6913834808, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "XM-76Q-2958", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "d37753651cdfb57ade7647f321fc8746c037f3445cf69c954a8d16d3864b5432", "output_hash": "cf42691eec772b9ec74d67643944de2e19e53724d7b772cef1e0f2d5ef3b4926"} | |
| 13312 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "856e10087b4b2cee539d82c7", "attempt_id": "2ac23a7da3ea", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:24.058308Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.29819452533488644, "origin_tokens": 1717, "compressed_tokens": 599, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1717, "source_tokens_receiver": 1717, "query_tokens": 703, "message_tokens": 599, "message_utf8_bytes": 2267, "cache_tensor_bytes": null, "serialized_payload_bytes": 2267, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 131.40666694380343, "decode_payload_ms": 0.0, "receiver_prefill_ms": 82.25337509065866, "ttft_ms": 13.436082983389497, "decode_ms": 120.62862503807992}, "total_wall_ms": 217.55254198797047, "ttft_ms": 13.436082983389497, "input_usage": {"receiver_prompt_tokens": 703}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 9837084672, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6917914448, "mlx_cache_bytes": 922963760, "process_rss_bytes": 9837084672}, "peak_prefill_memory": null, "peak_decode_memory": 6917914448, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 412-V, La Tuque.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.888888888888889}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "d37753651cdfb57ade7647f321fc8746c037f3445cf69c954a8d16d3864b5432", "output_hash": "8589a552e6e482abb94f41c9f8d0db6d30f130554531457467c17e51b1c3db40"} | |
| 13313 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "c37be386e86668f8570ce142", "attempt_id": "fca0493ed3ae", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:24.297831Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.29819452533488644, "origin_tokens": 1717, "compressed_tokens": 599, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1717, "source_tokens_receiver": 1717, "query_tokens": 702, "message_tokens": 599, "message_utf8_bytes": 2267, "cache_tensor_bytes": null, "serialized_payload_bytes": 2267, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 131.40666694380343, "decode_payload_ms": 0.0, "receiver_prefill_ms": 80.47770895063877, "ttft_ms": 13.465958996675909, "decode_ms": 26.68424998410046}, "total_wall_ms": 121.8952089548111, "ttft_ms": 13.465958996675909, "input_usage": {"receiver_prompt_tokens": 702}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 9837084672, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6952353616, "mlx_cache_bytes": 966053680, "process_rss_bytes": 9837084672}, "peak_prefill_memory": null, "peak_decode_memory": 6952353616, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "12.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "d37753651cdfb57ade7647f321fc8746c037f3445cf69c954a8d16d3864b5432", "output_hash": "25602777cecc667d222cfeb509c62be1591a64d751c3142c1381dee13677a294"} | |
| 13314 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "3373fc8d05122d8967101a79", "attempt_id": "03a723eb6019", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:24.440948Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.29819452533488644, "origin_tokens": 1717, "compressed_tokens": 599, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1717, "source_tokens_receiver": 1717, "query_tokens": 697, "message_tokens": 599, "message_utf8_bytes": 2267, "cache_tensor_bytes": null, "serialized_payload_bytes": 2267, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 131.40666694380343, "decode_payload_ms": 0.0, "receiver_prefill_ms": 80.52091603167355, "ttft_ms": 13.448041980154812, "decode_ms": 79.8771670088172}, "total_wall_ms": 175.02349999267608, "ttft_ms": 13.448041980154812, "input_usage": {"receiver_prompt_tokens": 697}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 9837084672, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6913834808, "mlx_cache_bytes": 966053680, "process_rss_bytes": 9837084672}, "peak_prefill_memory": null, "peak_decode_memory": 6913834808, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Baie-Comeau.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "d37753651cdfb57ade7647f321fc8746c037f3445cf69c954a8d16d3864b5432", "output_hash": "1983764ed5eade23c262b4dc64006483a2ed1387c947c094372bb23627643740"} | |
| 13315 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "beb9b77d49e6d23fe298c7bf", "attempt_id": "d3f0e1e54cf2", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:24.636820Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.29819452533488644, "origin_tokens": 1717, "compressed_tokens": 599, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1717, "source_tokens_receiver": 1717, "query_tokens": 706, "message_tokens": 599, "message_utf8_bytes": 2267, "cache_tensor_bytes": null, "serialized_payload_bytes": 2267, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 131.40666694380343, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.01883297786117, "ttft_ms": 13.520624954253435, "decode_ms": 40.04679201170802}, "total_wall_ms": 135.82333293743432, "ttft_ms": 13.520624954253435, "input_usage": {"receiver_prompt_tokens": 706}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 9837084672, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6919847772, "mlx_cache_bytes": 1387010612, "process_rss_bytes": 9837084672}, "peak_prefill_memory": null, "peak_decode_memory": 6919847772, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "9,369", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "d37753651cdfb57ade7647f321fc8746c037f3445cf69c954a8d16d3864b5432", "output_hash": "27f1cfb0e1eae007bb34269321afd51928fe82cc9e903b69fea2b27ee9acfed7"} | |
| 13316 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "61338617f19c57e9888b4503", "attempt_id": "6e41a48f1c21", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:25.205061Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.090892952245695, "origin_tokens": 5633, "compressed_tokens": 611, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5633, "source_tokens_receiver": 5633, "query_tokens": 710, "message_tokens": 611, "message_utf8_bytes": 2932, "cache_tensor_bytes": null, "serialized_payload_bytes": 2932, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 407.9842499922961, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.26316592097282, "ttft_ms": 13.588458998128772, "decode_ms": 13.444832991808653}, "total_wall_ms": 109.66783307958394, "ttft_ms": 13.588458998128772, "input_usage": {"receiver_prompt_tokens": 710}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9837084672, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6921666412, "mlx_cache_bytes": 512033900, "process_rss_bytes": 9837084672}, "peak_prefill_memory": null, "peak_decode_memory": 6921666412, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "47e3d8e12c10eee6a1c6173207537ddabaa3435d88b25b89ab810b284983ef89", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13317 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "ba5cf092e17645cdd4cfc555", "attempt_id": "ba7af663bf09", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:25.342161Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.090892952245695, "origin_tokens": 5633, "compressed_tokens": 611, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5633, "source_tokens_receiver": 5633, "query_tokens": 715, "message_tokens": 611, "message_utf8_bytes": 2932, "cache_tensor_bytes": null, "serialized_payload_bytes": 2932, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 407.9842499922961, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.52179105672985, "ttft_ms": 13.650167034938931, "decode_ms": 13.311666902154684}, "total_wall_ms": 109.75912492722273, "ttft_ms": 13.650167034938931, "input_usage": {"receiver_prompt_tokens": 715}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9837101056, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6924664704, "mlx_cache_bytes": 937955220, "process_rss_bytes": 9837101056}, "peak_prefill_memory": null, "peak_decode_memory": 6924664704, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "47e3d8e12c10eee6a1c6173207537ddabaa3435d88b25b89ab810b284983ef89", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13318 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "e8b85a07ca5669a3e4684c1f", "attempt_id": "2c1b966e9660", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:25.478342Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.090892952245695, "origin_tokens": 5633, "compressed_tokens": 611, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5633, "source_tokens_receiver": 5633, "query_tokens": 714, "message_tokens": 611, "message_utf8_bytes": 2932, "cache_tensor_bytes": null, "serialized_payload_bytes": 2932, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 407.9842499922961, "decode_payload_ms": 0.0, "receiver_prefill_ms": 80.81312500871718, "ttft_ms": 13.47337500192225, "decode_ms": 13.439750066027045}, "total_wall_ms": 108.99958293884993, "ttft_ms": 13.47337500192225, "input_usage": {"receiver_prompt_tokens": 714}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9837101056, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6924664704, "mlx_cache_bytes": 937955220, "process_rss_bytes": 9837101056}, "peak_prefill_memory": null, "peak_decode_memory": 6924664704, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "47e3d8e12c10eee6a1c6173207537ddabaa3435d88b25b89ab810b284983ef89", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13319 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "f1823930455f93293faf970a", "attempt_id": "6d6c5df41c85", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:25.613821Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.090892952245695, "origin_tokens": 5633, "compressed_tokens": 611, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5633, "source_tokens_receiver": 5633, "query_tokens": 710, "message_tokens": 611, "message_utf8_bytes": 2932, "cache_tensor_bytes": null, "serialized_payload_bytes": 2932, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 407.9842499922961, "decode_payload_ms": 0.0, "receiver_prefill_ms": 80.76729194726795, "ttft_ms": 13.472500024363399, "decode_ms": 13.40845797676593}, "total_wall_ms": 108.89720800332725, "ttft_ms": 13.472500024363399, "input_usage": {"receiver_prompt_tokens": 710}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9837101056, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6921666412, "mlx_cache_bytes": 937955220, "process_rss_bytes": 9837101056}, "peak_prefill_memory": null, "peak_decode_memory": 6921666412, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "47e3d8e12c10eee6a1c6173207537ddabaa3435d88b25b89ab810b284983ef89", "output_hash": "b764cdc0eab7137467211272fa539f1260d1bf2e71bcf6ff3bdc960f5c16aa14"} | |
| 13320 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "e620629976e52bc9b56fd6b5", "attempt_id": "441a24dca1f2", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:25.749119Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.090892952245695, "origin_tokens": 5633, "compressed_tokens": 611, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5633, "source_tokens_receiver": 5633, "query_tokens": 718, "message_tokens": 611, "message_utf8_bytes": 2932, "cache_tensor_bytes": null, "serialized_payload_bytes": 2932, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 407.9842499922961, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.22354105580598, "ttft_ms": 13.476624968461692, "decode_ms": 13.359582982957363}, "total_wall_ms": 109.31908409111202, "ttft_ms": 13.476624968461692, "input_usage": {"receiver_prompt_tokens": 718}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9837101056, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6926303116, "mlx_cache_bytes": 1339022024, "process_rss_bytes": 9837101056}, "peak_prefill_memory": null, "peak_decode_memory": 6926303116, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "47e3d8e12c10eee6a1c6173207537ddabaa3435d88b25b89ab810b284983ef89", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13321 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "8e5bd76fa18e0f2fc2456ed0", "attempt_id": "9327eea20e70", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:26.689730Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.04757480022300688, "origin_tokens": 10771, "compressed_tokens": 529, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10762, "source_tokens_receiver": 10762, "query_tokens": 627, "message_tokens": 529, "message_utf8_bytes": 2644, "cache_tensor_bytes": null, "serialized_payload_bytes": 2644, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 801.106124999933, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.56787494104356, "ttft_ms": 13.49212508648634, "decode_ms": 53.819790948182344}, "total_wall_ms": 144.15887498762459, "ttft_ms": 13.49212508648634, "input_usage": {"receiver_prompt_tokens": 627}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 9837330432, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6873660960, "mlx_cache_bytes": 462668576, "process_rss_bytes": 9837330432}, "peak_prefill_memory": null, "peak_decode_memory": 6873660960, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Schefferville", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "f4ccf81eb999a26957f26f1004f241c85fa3c90fc3431b0519db286f45540676", "output_hash": "123b0852843e9939437f362f86da3c29910132ad9926dd4a6d2ec56cc7af472e"} | |
| 13322 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "71af2edddc666df3f6c12cf3", "attempt_id": "90fe54a58e99", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:26.868716Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.04757480022300688, "origin_tokens": 10771, "compressed_tokens": 529, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10762, "source_tokens_receiver": 10762, "query_tokens": 632, "message_tokens": 529, "message_utf8_bytes": 2644, "cache_tensor_bytes": null, "serialized_payload_bytes": 2644, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 801.106124999933, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.44866704847664, "ttft_ms": 13.548833085224032, "decode_ms": 13.507624971680343}, "total_wall_ms": 103.72545896098018, "ttft_ms": 13.548833085224032, "input_usage": {"receiver_prompt_tokens": 632}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9837346816, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6876560948, "mlx_cache_bytes": 815828220, "process_rss_bytes": 9837346816}, "peak_prefill_memory": null, "peak_decode_memory": 6876560948, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "f4ccf81eb999a26957f26f1004f241c85fa3c90fc3431b0519db286f45540676", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13323 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "11b5d8e71b69ab1f117a3d84", "attempt_id": "1eaf90216b51", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:27.006247Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.04757480022300688, "origin_tokens": 10771, "compressed_tokens": 529, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10762, "source_tokens_receiver": 10762, "query_tokens": 632, "message_tokens": 529, "message_utf8_bytes": 2644, "cache_tensor_bytes": null, "serialized_payload_bytes": 2644, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 801.106124999933, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.44049993157387, "ttft_ms": 13.647667015902698, "decode_ms": 13.379666954278946}, "total_wall_ms": 103.63395803142339, "ttft_ms": 13.647667015902698, "input_usage": {"receiver_prompt_tokens": 632}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9837346816, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6876560948, "mlx_cache_bytes": 815828220, "process_rss_bytes": 9837346816}, "peak_prefill_memory": null, "peak_decode_memory": 6876560948, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "f4ccf81eb999a26957f26f1004f241c85fa3c90fc3431b0519db286f45540676", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13324 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "61814ea39ebc24e7542f2f62", "attempt_id": "9db798804f9e", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:27.143269Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.04757480022300688, "origin_tokens": 10771, "compressed_tokens": 529, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10762, "source_tokens_receiver": 10762, "query_tokens": 628, "message_tokens": 529, "message_utf8_bytes": 2644, "cache_tensor_bytes": null, "serialized_payload_bytes": 2644, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 801.106124999933, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.25812496896833, "ttft_ms": 13.28083302360028, "decode_ms": 13.308333000168204}, "total_wall_ms": 103.17112505435944, "ttft_ms": 13.28083302360028, "input_usage": {"receiver_prompt_tokens": 628}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9837346816, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6906347060, "mlx_cache_bytes": 1039502588, "process_rss_bytes": 9837346816}, "peak_prefill_memory": null, "peak_decode_memory": 6906347060, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "f4ccf81eb999a26957f26f1004f241c85fa3c90fc3431b0519db286f45540676", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13325 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "5fbaf86b249e4aa3ec5f972f", "attempt_id": "ebc414117b3a", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:27.280504Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.04757480022300688, "origin_tokens": 10771, "compressed_tokens": 529, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10762, "source_tokens_receiver": 10762, "query_tokens": 636, "message_tokens": 529, "message_utf8_bytes": 2644, "cache_tensor_bytes": null, "serialized_payload_bytes": 2644, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 801.106124999933, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.23333297669888, "ttft_ms": 13.575250050053, "decode_ms": 13.594208052381873}, "total_wall_ms": 104.59416708908975, "ttft_ms": 13.575250050053, "input_usage": {"receiver_prompt_tokens": 636}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9837346816, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6879379012, "mlx_cache_bytes": 1418843880, "process_rss_bytes": 9837346816}, "peak_prefill_memory": null, "peak_decode_memory": 6879379012, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "f4ccf81eb999a26957f26f1004f241c85fa3c90fc3431b0519db286f45540676", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13326 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "06da8a1672751aa9ca757495", "attempt_id": "0c2da0af41ea", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:27.554281Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.28926553672316385, "origin_tokens": 1770, "compressed_tokens": 588, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1770, "source_tokens_receiver": 1770, "query_tokens": 687, "message_tokens": 588, "message_utf8_bytes": 2272, "cache_tensor_bytes": null, "serialized_payload_bytes": 2272, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 132.705416996032, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.05258294381201, "ttft_ms": 13.896625023335218, "decode_ms": 13.431750005111098}, "total_wall_ms": 109.6271249698475, "ttft_ms": 13.896625023335218, "input_usage": {"receiver_prompt_tokens": 687}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9837346816, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6908641040, "mlx_cache_bytes": 498631696, "process_rss_bytes": 9837346816}, "peak_prefill_memory": null, "peak_decode_memory": 6908641040, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "d8df937f8da5a696158e8a1446273786197c202fb86872d6fef677668be03b5f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13327 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "c830e5b0b344c78b2757886b", "attempt_id": "c3ab40b2c9f2", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:27.686264Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.28926553672316385, "origin_tokens": 1770, "compressed_tokens": 588, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1770, "source_tokens_receiver": 1770, "query_tokens": 692, "message_tokens": 588, "message_utf8_bytes": 2272, "cache_tensor_bytes": null, "serialized_payload_bytes": 2272, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 132.705416996032, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.12991601228714, "ttft_ms": 13.508333009667695, "decode_ms": 134.47612500749528}, "total_wall_ms": 230.38358404301107, "ttft_ms": 13.508333009667695, "input_usage": {"receiver_prompt_tokens": 692}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 9837363200, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6911835940, "mlx_cache_bytes": 911347420, "process_rss_bytes": 9837363200}, "peak_prefill_memory": null, "peak_decode_memory": 6911835940, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 94-V, Mont-Laurier.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "d8df937f8da5a696158e8a1446273786197c202fb86872d6fef677668be03b5f", "output_hash": "889eab3a8175f92017845cddf5aaa5f561db4019f6a97bbcaabc7f6a54974f33"} | |
| 13328 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "5517d853a359e9ed2f9c6a1e", "attempt_id": "6de1b8aa96a7", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:27.937898Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.28926553672316385, "origin_tokens": 1770, "compressed_tokens": 588, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1770, "source_tokens_receiver": 1770, "query_tokens": 691, "message_tokens": 588, "message_utf8_bytes": 2272, "cache_tensor_bytes": null, "serialized_payload_bytes": 2272, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 132.705416996032, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.12820901442319, "ttft_ms": 13.528999988920987, "decode_ms": 53.33645804785192}, "total_wall_ms": 149.2738330271095, "ttft_ms": 13.528999988920987, "input_usage": {"receiver_prompt_tokens": 691}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 9837363200, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6945750820, "mlx_cache_bytes": 953781980, "process_rss_bytes": 9837363200}, "peak_prefill_memory": null, "peak_decode_memory": 6945750820, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "32.8676", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "d8df937f8da5a696158e8a1446273786197c202fb86872d6fef677668be03b5f", "output_hash": "520ae1b2810b61f606b08593758796f82b0309e238b5baba5846523b2369e949"} | |
| 13329 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "5329632c59db9847a6f4c7dc", "attempt_id": "d1fb3470f3ea", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:28.108413Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.28926553672316385, "origin_tokens": 1770, "compressed_tokens": 588, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1770, "source_tokens_receiver": 1770, "query_tokens": 686, "message_tokens": 588, "message_utf8_bytes": 2272, "cache_tensor_bytes": null, "serialized_payload_bytes": 2272, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 132.705416996032, "decode_payload_ms": 0.0, "receiver_prefill_ms": 80.70362498983741, "ttft_ms": 13.473291997797787, "decode_ms": 107.45958401821554}, "total_wall_ms": 202.82500004395843, "ttft_ms": 13.473291997797787, "input_usage": {"receiver_prompt_tokens": 686}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 9837363200, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6942293776, "mlx_cache_bytes": 995888860, "process_rss_bytes": 9837363200}, "peak_prefill_memory": null, "peak_decode_memory": 6942293776, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Felker-16, no name.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "d8df937f8da5a696158e8a1446273786197c202fb86872d6fef677668be03b5f", "output_hash": "503e4aecf7b42f59a70eba64e5160a8d367f15c8e3821cd96d36709f5418f4ee"} | |
| 13330 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "c4db781fb6d55dee37ad4b55", "attempt_id": "1a37bd8ed007", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:28.333051Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.28926553672316385, "origin_tokens": 1770, "compressed_tokens": 588, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1770, "source_tokens_receiver": 1770, "query_tokens": 695, "message_tokens": 588, "message_utf8_bytes": 2272, "cache_tensor_bytes": null, "serialized_payload_bytes": 2272, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 132.705416996032, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.41087496187538, "ttft_ms": 13.381791999563575, "decode_ms": 40.59016704559326}, "total_wall_ms": 136.57358300406486, "ttft_ms": 13.381791999563575, "input_usage": {"receiver_prompt_tokens": 695}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 9837363200, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6913277744, "mlx_cache_bytes": 1384438196, "process_rss_bytes": 9837363200}, "peak_prefill_memory": null, "peak_decode_memory": 6913277744, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4,670", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "d8df937f8da5a696158e8a1446273786197c202fb86872d6fef677668be03b5f", "output_hash": "ec6c6b600939a99921fa54f20e8307a794be9784727ffd460b61a3db8974f6e1"} | |
| 13331 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "2933aa7c9adf946215a394a2", "attempt_id": "e75c7e93a484", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:28.916636Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09139593002499108, "origin_tokens": 5602, "compressed_tokens": 601, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 700, "message_tokens": 601, "message_utf8_bytes": 2965, "cache_tensor_bytes": null, "serialized_payload_bytes": 2965, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 422.1863750135526, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.55812497716397, "ttft_ms": 13.557457947172225, "decode_ms": 13.527875067666173}, "total_wall_ms": 110.01608392689377, "ttft_ms": 13.557457947172225, "input_usage": {"receiver_prompt_tokens": 700}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9837412352, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6916472644, "mlx_cache_bytes": 506676292, "process_rss_bytes": 9837412352}, "peak_prefill_memory": null, "peak_decode_memory": 6916472644, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "15068589f08254b87e572335d18d1bb1d63baf3a17e7734857607e732254ab03", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13332 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "1648d20c65f6d95e54fbc5a4", "attempt_id": "baa300b28ace", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:29.054692Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09139593002499108, "origin_tokens": 5602, "compressed_tokens": 601, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 705, "message_tokens": 601, "message_utf8_bytes": 2965, "cache_tensor_bytes": null, "serialized_payload_bytes": 2965, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 422.1863750135526, "decode_payload_ms": 0.0, "receiver_prefill_ms": 79.97195795178413, "ttft_ms": 13.368583051487803, "decode_ms": 13.531291973777115}, "total_wall_ms": 108.1840000115335, "ttft_ms": 13.368583051487803, "input_usage": {"receiver_prompt_tokens": 705}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9837428736, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6918471512, "mlx_cache_bytes": 900288324, "process_rss_bytes": 9837428736}, "peak_prefill_memory": null, "peak_decode_memory": 6918471512, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "15068589f08254b87e572335d18d1bb1d63baf3a17e7734857607e732254ab03", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13333 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "c775134c8b4f8bb37033ef28", "attempt_id": "5722955ab486", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:29.189359Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09139593002499108, "origin_tokens": 5602, "compressed_tokens": 601, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 704, "message_tokens": 601, "message_utf8_bytes": 2965, "cache_tensor_bytes": null, "serialized_payload_bytes": 2965, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 422.1863750135526, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.49737503845245, "ttft_ms": 13.479875051416457, "decode_ms": 13.450167025439441}, "total_wall_ms": 109.65662496164441, "ttft_ms": 13.479875051416457, "input_usage": {"receiver_prompt_tokens": 704}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9837428736, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6918471512, "mlx_cache_bytes": 900288324, "process_rss_bytes": 9837428736}, "peak_prefill_memory": null, "peak_decode_memory": 6918471512, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "15068589f08254b87e572335d18d1bb1d63baf3a17e7734857607e732254ab03", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13334 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "055c351f6aa50650f8cacc10", "attempt_id": "ec1465fa984f", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:29.325930Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09139593002499108, "origin_tokens": 5602, "compressed_tokens": 601, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 699, "message_tokens": 601, "message_utf8_bytes": 2965, "cache_tensor_bytes": null, "serialized_payload_bytes": 2965, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 422.1863750135526, "decode_payload_ms": 0.0, "receiver_prefill_ms": 80.71358304005116, "ttft_ms": 13.409083941951394, "decode_ms": 13.664041995070875}, "total_wall_ms": 109.01254194322973, "ttft_ms": 13.409083941951394, "input_usage": {"receiver_prompt_tokens": 699}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9837428736, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6950780740, "mlx_cache_bytes": 943214404, "process_rss_bytes": 9837428736}, "peak_prefill_memory": null, "peak_decode_memory": 6950780740, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "15068589f08254b87e572335d18d1bb1d63baf3a17e7734857607e732254ab03", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13335 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "32c45e81d46b75020f497e26", "attempt_id": "172d8226cb9e", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:29.461993Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09139593002499108, "origin_tokens": 5602, "compressed_tokens": 601, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 708, "message_tokens": 601, "message_utf8_bytes": 2965, "cache_tensor_bytes": null, "serialized_payload_bytes": 2965, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 422.1863750135526, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.45224989857525, "ttft_ms": 13.403124990873039, "decode_ms": 13.626542058773339}, "total_wall_ms": 109.72304199822247, "ttft_ms": 13.403124990873039, "input_usage": {"receiver_prompt_tokens": 708}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9837428736, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6921109348, "mlx_cache_bytes": 1365465680, "process_rss_bytes": 9837428736}, "peak_prefill_memory": null, "peak_decode_memory": 6921109348, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "15068589f08254b87e572335d18d1bb1d63baf3a17e7734857607e732254ab03", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13336 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "abd1f87f688162ded6bafed0", "attempt_id": "69441c94420b", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:30.361832Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.047473342605470564, "origin_tokens": 10785, "compressed_tokens": 526, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10785, "source_tokens_receiver": 10785, "query_tokens": 623, "message_tokens": 526, "message_utf8_bytes": 2633, "cache_tensor_bytes": null, "serialized_payload_bytes": 2633, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 759.6773330587894, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.44416701421142, "ttft_ms": 13.728290912695229, "decode_ms": 13.291124952957034}, "total_wall_ms": 103.68558403570205, "ttft_ms": 13.728290912695229, "input_usage": {"receiver_prompt_tokens": 623}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9839722496, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6871547408, "mlx_cache_bytes": 460489488, "process_rss_bytes": 9839722496}, "peak_prefill_memory": null, "peak_decode_memory": 6871547408, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "9b3e78275d12332cd4f2a7b43eb416eb415b9511b418eb26fa5f5164556f6590", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13337 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "40ffcb3653b3349371d73f97", "attempt_id": "62a012b4b0a4", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:30.500696Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.047473342605470564, "origin_tokens": 10785, "compressed_tokens": 526, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10785, "source_tokens_receiver": 10785, "query_tokens": 629, "message_tokens": 526, "message_utf8_bytes": 2633, "cache_tensor_bytes": null, "serialized_payload_bytes": 2633, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 759.6773330587894, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.3430420299992, "ttft_ms": 13.725915923714638, "decode_ms": 110.68912490736693}, "total_wall_ms": 201.03583298623562, "ttft_ms": 13.725915923714638, "input_usage": {"receiver_prompt_tokens": 629}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 9839738880, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6874922536, "mlx_cache_bytes": 835259616, "process_rss_bytes": 9839738880}, "peak_prefill_memory": null, "peak_decode_memory": 6874922536, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 939-D, Schefferville", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.5714285714285715}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "9b3e78275d12332cd4f2a7b43eb416eb415b9511b418eb26fa5f5164556f6590", "output_hash": "e6bfa929e380d728a57c6e763534886541434a6508a7c19dea6ddad4c6fa9399"} | |
| 13338 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "40f06139218fb7c7de574056", "attempt_id": "03cfc2865f47", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:30.735728Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.047473342605470564, "origin_tokens": 10785, "compressed_tokens": 526, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10785, "source_tokens_receiver": 10785, "query_tokens": 629, "message_tokens": 526, "message_utf8_bytes": 2633, "cache_tensor_bytes": null, "serialized_payload_bytes": 2633, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 759.6773330587894, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.07608307059854, "ttft_ms": 13.65470897872001, "decode_ms": 13.55558296199888}, "total_wall_ms": 103.55204192455858, "ttft_ms": 13.65470897872001, "input_usage": {"receiver_prompt_tokens": 629}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9839755264, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6874922536, "mlx_cache_bytes": 835259616, "process_rss_bytes": 9839755264}, "peak_prefill_memory": null, "peak_decode_memory": 6874922536, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "9b3e78275d12332cd4f2a7b43eb416eb415b9511b418eb26fa5f5164556f6590", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13339 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "f576fe7ba04f40e58d6efca0", "attempt_id": "a540aaaf1857", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:30.873812Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.047473342605470564, "origin_tokens": 10785, "compressed_tokens": 526, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10785, "source_tokens_receiver": 10785, "query_tokens": 625, "message_tokens": 526, "message_utf8_bytes": 2633, "cache_tensor_bytes": null, "serialized_payload_bytes": 2633, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 759.6773330587894, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.77050006855279, "ttft_ms": 13.538541970774531, "decode_ms": 27.188792009837925}, "total_wall_ms": 116.73658399377018, "ttft_ms": 13.538541970774531, "input_usage": {"receiver_prompt_tokens": 625}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 9839755264, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6872104488, "mlx_cache_bytes": 1019284704, "process_rss_bytes": 9839755264}, "peak_prefill_memory": null, "peak_decode_memory": 6872104488, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Unknown.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "9b3e78275d12332cd4f2a7b43eb416eb415b9511b418eb26fa5f5164556f6590", "output_hash": "9cf9f50925b2a7803c73826a305235d4215dc428721c731072a9f2c0f5d6ae5a"} | |
| 13340 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "0276aa2411153bef92eb7419", "attempt_id": "d05eee677dc3", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:31.025720Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.047473342605470564, "origin_tokens": 10785, "compressed_tokens": 526, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10785, "source_tokens_receiver": 10785, "query_tokens": 632, "message_tokens": 526, "message_utf8_bytes": 2633, "cache_tensor_bytes": null, "serialized_payload_bytes": 2633, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 759.6773330587894, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.8218750813976, "ttft_ms": 13.492457917891443, "decode_ms": 13.526541995815933}, "total_wall_ms": 103.09808410238475, "ttft_ms": 13.492457917891443, "input_usage": {"receiver_prompt_tokens": 632}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9839755264, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6876560948, "mlx_cache_bytes": 1372444348, "process_rss_bytes": 9839755264}, "peak_prefill_memory": null, "peak_decode_memory": 6876560948, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "9b3e78275d12332cd4f2a7b43eb416eb415b9511b418eb26fa5f5164556f6590", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13341 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "57216020d759a36951f08929", "attempt_id": "6b5ce46cd1ff", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:31.299349Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.289756649688738, "origin_tokens": 1767, "compressed_tokens": 596, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1767, "source_tokens_receiver": 1767, "query_tokens": 695, "message_tokens": 596, "message_utf8_bytes": 2198, "cache_tensor_bytes": null, "serialized_payload_bytes": 2198, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 132.11083295755088, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.28000004217029, "ttft_ms": 13.447624980472028, "decode_ms": 26.82837494648993}, "total_wall_ms": 122.82749998848885, "ttft_ms": 13.447624980472028, "input_usage": {"receiver_prompt_tokens": 695}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 9839738880, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6913277744, "mlx_cache_bytes": 503399472, "process_rss_bytes": 9839738880}, "peak_prefill_memory": null, "peak_decode_memory": 6913277744, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Unknown.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "3a7f9503c5a7bb00284aa19305b3cf05988c4a5063ce27b9e8690c4291dd3600", "output_hash": "9cf9f50925b2a7803c73826a305235d4215dc428721c731072a9f2c0f5d6ae5a"} | |
| 13342 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "1daa7b2b4e1f93a1b1bd5268", "attempt_id": "799d1b682def", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:31.444561Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.289756649688738, "origin_tokens": 1767, "compressed_tokens": 596, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1767, "source_tokens_receiver": 1767, "query_tokens": 700, "message_tokens": 596, "message_utf8_bytes": 2198, "cache_tensor_bytes": null, "serialized_payload_bytes": 2198, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 132.11083295755088, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.12850005272776, "ttft_ms": 13.662458048202097, "decode_ms": 147.82662503421307}, "total_wall_ms": 243.90291702002287, "ttft_ms": 13.662458048202097, "input_usage": {"receiver_prompt_tokens": 700}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 9839755264, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6916472644, "mlx_cache_bytes": 920882972, "process_rss_bytes": 9839755264}, "peak_prefill_memory": null, "peak_decode_memory": 6916472644, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Baie-Comeau, Lot 601-M.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "3a7f9503c5a7bb00284aa19305b3cf05988c4a5063ce27b9e8690c4291dd3600", "output_hash": "2eeccd6d37c2c63f57b31872b5edd5689c68051ec61234afbaeccf94cf1ee260"} | |
| 13343 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "02dbce332efc6512dbed6559", "attempt_id": "23d5915f1f83", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:31.710664Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.289756649688738, "origin_tokens": 1767, "compressed_tokens": 596, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1767, "source_tokens_receiver": 1767, "query_tokens": 700, "message_tokens": 596, "message_utf8_bytes": 2198, "cache_tensor_bytes": null, "serialized_payload_bytes": 2198, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 132.11083295755088, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.04541699867696, "ttft_ms": 13.534290948882699, "decode_ms": 53.61341708339751}, "total_wall_ms": 149.40987504087389, "ttft_ms": 13.534290948882699, "input_usage": {"receiver_prompt_tokens": 700}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 9839755264, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6916472644, "mlx_cache_bytes": 920882972, "process_rss_bytes": 9839755264}, "peak_prefill_memory": null, "peak_decode_memory": 6916472644, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "13.4343", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "3a7f9503c5a7bb00284aa19305b3cf05988c4a5063ce27b9e8690c4291dd3600", "output_hash": "599bc22e373b1cf7b4679208eb9e515ad0e8dcb88dde0c7f579637ec7d3f3014"} | |
| 13344 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "7546cd00dc46b9e779bb580d", "attempt_id": "df474a13fffe", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:31.882158Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.289756649688738, "origin_tokens": 1767, "compressed_tokens": 596, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1767, "source_tokens_receiver": 1767, "query_tokens": 696, "message_tokens": 596, "message_utf8_bytes": 2198, "cache_tensor_bytes": null, "serialized_payload_bytes": 2198, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 132.11083295755088, "decode_payload_ms": 0.0, "receiver_prefill_ms": 80.48133307602257, "ttft_ms": 13.62195797264576, "decode_ms": 107.36120794899762}, "total_wall_ms": 202.6998749934137, "ttft_ms": 13.62195797264576, "input_usage": {"receiver_prompt_tokens": 696}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 9839755264, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6913654596, "mlx_cache_bytes": 1125945116, "process_rss_bytes": 9839755264}, "peak_prefill_memory": null, "peak_decode_memory": 6913654596, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Priyamvada Dubrovnik", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "3a7f9503c5a7bb00284aa19305b3cf05988c4a5063ce27b9e8690c4291dd3600", "output_hash": "adc9a20b9adc1d63e08a6e4c1f5160bd8343c4e09ea9e1ab7296ec885a822f95"} | |
| 13345 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "1443d2d802348d6446fe6234", "attempt_id": "86d4b965df26", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:32.107140Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.289756649688738, "origin_tokens": 1767, "compressed_tokens": 596, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1767, "source_tokens_receiver": 1767, "query_tokens": 701, "message_tokens": 596, "message_utf8_bytes": 2198, "cache_tensor_bytes": null, "serialized_payload_bytes": 2198, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 132.11083295755088, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.14820800255984, "ttft_ms": 13.639417011290789, "decode_ms": 13.375916983932257}, "total_wall_ms": 109.40720909275115, "ttft_ms": 13.639417011290789, "input_usage": {"receiver_prompt_tokens": 701}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9839755264, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6916652872, "mlx_cache_bytes": 1263573516, "process_rss_bytes": 9839755264}, "peak_prefill_memory": null, "peak_decode_memory": 6916652872, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "3a7f9503c5a7bb00284aa19305b3cf05988c4a5063ce27b9e8690c4291dd3600", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13346 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "ee77cb04766b5cb0fdf215f1", "attempt_id": "ee6ea81e6f42", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:32.657794Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09121681810083734, "origin_tokens": 5613, "compressed_tokens": 613, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5613, "source_tokens_receiver": 5613, "query_tokens": 711, "message_tokens": 613, "message_utf8_bytes": 2937, "cache_tensor_bytes": null, "serialized_payload_bytes": 2937, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 416.669666999951, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.84179197996855, "ttft_ms": 13.72908300254494, "decode_ms": 13.961625052616}, "total_wall_ms": 110.92562496196479, "ttft_ms": 13.72908300254494, "input_usage": {"receiver_prompt_tokens": 711}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9839755264, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6922551152, "mlx_cache_bytes": 512935024, "process_rss_bytes": 9839755264}, "peak_prefill_memory": null, "peak_decode_memory": 6922551152, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "51e05e3cfb30216ccd292f40ec32a8a5fb8950328c8797596f807ef63fbdf4b0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13347 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "2413a33ec9a6c4f1c4f62422", "attempt_id": "6c7b0e582ac1", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:32.797201Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09121681810083734, "origin_tokens": 5613, "compressed_tokens": 613, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5613, "source_tokens_receiver": 5613, "query_tokens": 717, "message_tokens": 613, "message_utf8_bytes": 2937, "cache_tensor_bytes": null, "serialized_payload_bytes": 2937, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 416.669666999951, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.0821249615401, "ttft_ms": 13.54737498331815, "decode_ms": 122.06437508575618}, "total_wall_ms": 218.0518750101328, "ttft_ms": 13.54737498331815, "input_usage": {"receiver_prompt_tokens": 717}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 9839771648, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6925926280, "mlx_cache_bytes": 940150688, "process_rss_bytes": 9839771648}, "peak_prefill_memory": null, "peak_decode_memory": 6925926280, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Témiscaming, Lot 229-K", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "51e05e3cfb30216ccd292f40ec32a8a5fb8950328c8797596f807ef63fbdf4b0", "output_hash": "156b1d3ced69e67a5176d18a4331fe85d75f1ca47de6ed6a74d646c11b7a32b4"} | |
| 13348 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "69bcddd21dfce1637b874184", "attempt_id": "65a387c22e44", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:33.042062Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09121681810083734, "origin_tokens": 5613, "compressed_tokens": 613, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5613, "source_tokens_receiver": 5613, "query_tokens": 716, "message_tokens": 613, "message_utf8_bytes": 2937, "cache_tensor_bytes": null, "serialized_payload_bytes": 2937, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 416.669666999951, "decode_payload_ms": 0.0, "receiver_prefill_ms": 80.65412496216595, "ttft_ms": 14.080459019169211, "decode_ms": 13.313458068296313}, "total_wall_ms": 109.38216699287295, "ttft_ms": 14.080459019169211, "input_usage": {"receiver_prompt_tokens": 716}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9839771648, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6925926280, "mlx_cache_bytes": 940150688, "process_rss_bytes": 9839771648}, "peak_prefill_memory": null, "peak_decode_memory": 6925926280, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "51e05e3cfb30216ccd292f40ec32a8a5fb8950328c8797596f807ef63fbdf4b0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13349 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "de47d6abb2214d2a8c2d707a", "attempt_id": "33a60bf09d80", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:33.178553Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09121681810083734, "origin_tokens": 5613, "compressed_tokens": 613, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5613, "source_tokens_receiver": 5613, "query_tokens": 711, "message_tokens": 613, "message_utf8_bytes": 2937, "cache_tensor_bytes": null, "serialized_payload_bytes": 2937, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 416.669666999951, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.15274994634092, "ttft_ms": 13.453958090394735, "decode_ms": 13.277124962769449}, "total_wall_ms": 109.22012501396239, "ttft_ms": 13.453958090394735, "input_usage": {"receiver_prompt_tokens": 711}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9839771648, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6922551152, "mlx_cache_bytes": 940150688, "process_rss_bytes": 9839771648}, "peak_prefill_memory": null, "peak_decode_memory": 6922551152, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "51e05e3cfb30216ccd292f40ec32a8a5fb8950328c8797596f807ef63fbdf4b0", "output_hash": "b764cdc0eab7137467211272fa539f1260d1bf2e71bcf6ff3bdc960f5c16aa14"} | |
| 13350 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "3bd1e282205420ee37258e9a", "attempt_id": "aee57800f0ba", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:33.316590Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09121681810083734, "origin_tokens": 5613, "compressed_tokens": 613, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5613, "source_tokens_receiver": 5613, "query_tokens": 721, "message_tokens": 613, "message_utf8_bytes": 2937, "cache_tensor_bytes": null, "serialized_payload_bytes": 2937, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 416.669666999951, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.03683404624462, "ttft_ms": 13.39770806953311, "decode_ms": 13.556249905377626}, "total_wall_ms": 109.29654096253216, "ttft_ms": 13.39770806953311, "input_usage": {"receiver_prompt_tokens": 721}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9839771648, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6927744920, "mlx_cache_bytes": 1342708448, "process_rss_bytes": 9839771648}, "peak_prefill_memory": null, "peak_decode_memory": 6927744920, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "51e05e3cfb30216ccd292f40ec32a8a5fb8950328c8797596f807ef63fbdf4b0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13351 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "118429ec5446096b42251904", "attempt_id": "d32a1ba74dac", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:34.214063Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.04729355255865509, "origin_tokens": 10826, "compressed_tokens": 521, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10826, "source_tokens_receiver": 10826, "query_tokens": 620, "message_tokens": 521, "message_utf8_bytes": 2593, "cache_tensor_bytes": null, "serialized_payload_bytes": 2593, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 756.664082990028, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.96812508907169, "ttft_ms": 13.8090830296278, "decode_ms": 13.304666033945978}, "total_wall_ms": 103.30629104282707, "ttft_ms": 13.8090830296278, "input_usage": {"receiver_prompt_tokens": 620}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9839886336, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6870105604, "mlx_cache_bytes": 458998532, "process_rss_bytes": 9839886336}, "peak_prefill_memory": null, "peak_decode_memory": 6870105604, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "8448b83493e8ea18c8cdcc5c9e7612e320cbc803adc62e7160de7908455ca2c2", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13352 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "39f55823032c69f22100111e", "attempt_id": "547a5f4220be", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:34.352328Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.04729355255865509, "origin_tokens": 10826, "compressed_tokens": 521, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10826, "source_tokens_receiver": 10826, "query_tokens": 627, "message_tokens": 521, "message_utf8_bytes": 2593, "cache_tensor_bytes": null, "serialized_payload_bytes": 2593, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 756.664082990028, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.12029202189296, "ttft_ms": 13.407874968834221, "decode_ms": 13.694041059352458}, "total_wall_ms": 103.53154200129211, "ttft_ms": 13.407874968834221, "input_usage": {"receiver_prompt_tokens": 627}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9839902720, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6873660960, "mlx_cache_bytes": 832474316, "process_rss_bytes": 9839902720}, "peak_prefill_memory": null, "peak_decode_memory": 6873660960, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "8448b83493e8ea18c8cdcc5c9e7612e320cbc803adc62e7160de7908455ca2c2", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13353 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "b1674abefe6525a2114e1ad1", "attempt_id": "db6242747f4f", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:34.491513Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.04729355255865509, "origin_tokens": 10826, "compressed_tokens": 521, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10826, "source_tokens_receiver": 10826, "query_tokens": 626, "message_tokens": 521, "message_utf8_bytes": 2593, "cache_tensor_bytes": null, "serialized_payload_bytes": 2593, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 756.664082990028, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.97100008185953, "ttft_ms": 13.47791706211865, "decode_ms": 13.488749973475933}, "total_wall_ms": 103.13612502068281, "ttft_ms": 13.47791706211865, "input_usage": {"receiver_prompt_tokens": 626}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9839902720, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6873660960, "mlx_cache_bytes": 832474316, "process_rss_bytes": 9839902720}, "peak_prefill_memory": null, "peak_decode_memory": 6873660960, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "8448b83493e8ea18c8cdcc5c9e7612e320cbc803adc62e7160de7908455ca2c2", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13354 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "85b8c2221eef2f2812b35c11", "attempt_id": "70a318654ef6", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:34.628895Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.04729355255865509, "origin_tokens": 10826, "compressed_tokens": 521, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10826, "source_tokens_receiver": 10826, "query_tokens": 622, "message_tokens": 521, "message_utf8_bytes": 2593, "cache_tensor_bytes": null, "serialized_payload_bytes": 2593, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 756.664082990028, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.64166707359254, "ttft_ms": 13.486583949998021, "decode_ms": 13.744125026278198}, "total_wall_ms": 103.06679201312363, "ttft_ms": 13.486583949998021, "input_usage": {"receiver_prompt_tokens": 622}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9839902720, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6870662688, "mlx_cache_bytes": 1015712972, "process_rss_bytes": 9839902720}, "peak_prefill_memory": null, "peak_decode_memory": 6870662688, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "8448b83493e8ea18c8cdcc5c9e7612e320cbc803adc62e7160de7908455ca2c2", "output_hash": "b764cdc0eab7137467211272fa539f1260d1bf2e71bcf6ff3bdc960f5c16aa14"} | |
| 13355 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "23367c740aec333194861d5e", "attempt_id": "ca58f5ceb3c6", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:34.766327Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.04729355255865509, "origin_tokens": 10826, "compressed_tokens": 521, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10826, "source_tokens_receiver": 10826, "query_tokens": 628, "message_tokens": 521, "message_utf8_bytes": 2593, "cache_tensor_bytes": null, "serialized_payload_bytes": 2593, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 756.664082990028, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.45791694428772, "ttft_ms": 13.702999916858971, "decode_ms": 13.603499974124134}, "total_wall_ms": 104.01499993167818, "ttft_ms": 13.702999916858971, "input_usage": {"receiver_prompt_tokens": 628}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9839902720, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6874742308, "mlx_cache_bytes": 1366988440, "process_rss_bytes": 9839902720}, "peak_prefill_memory": null, "peak_decode_memory": 6874742308, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "8448b83493e8ea18c8cdcc5c9e7612e320cbc803adc62e7160de7908455ca2c2", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13356 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "3148b31e2f21e82980a680e5", "attempt_id": "d1d1582c2ea2", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:35.040777Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.29408385985066055, "origin_tokens": 1741, "compressed_tokens": 610, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1741, "source_tokens_receiver": 1741, "query_tokens": 709, "message_tokens": 610, "message_utf8_bytes": 2227, "cache_tensor_bytes": null, "serialized_payload_bytes": 2227, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 132.59024999570101, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.21574996039271, "ttft_ms": 13.811833108775318, "decode_ms": 111.53400002513081}, "total_wall_ms": 207.9266660148278, "ttft_ms": 13.811833108775318, "input_usage": {"receiver_prompt_tokens": 709}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 9839919104, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6921289576, "mlx_cache_bytes": 511640680, "process_rss_bytes": 9839919104}, "peak_prefill_memory": null, "peak_decode_memory": 6921289576, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "GK-89M-5278", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "5ff9eec84b479180cc771b15d683184131094a132cb3edc87caeef285e56096e", "output_hash": "4e341227263a52b9d9acb67622f40b4070f4066768b00cd60b5a08c6be006b0a"} | |
| 13357 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "0204d2def3f80c04b9f20a62", "attempt_id": "fe5bcb050637", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:35.271102Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.29408385985066055, "origin_tokens": 1741, "compressed_tokens": 610, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1741, "source_tokens_receiver": 1741, "query_tokens": 713, "message_tokens": 610, "message_utf8_bytes": 2227, "cache_tensor_bytes": null, "serialized_payload_bytes": 2227, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 132.59024999570101, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.45070797763765, "ttft_ms": 13.928917003795505, "decode_ms": 13.688832987099886}, "total_wall_ms": 110.44887499883771, "ttft_ms": 13.928917003795505, "input_usage": {"receiver_prompt_tokens": 713}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9839935488, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6923108216, "mlx_cache_bytes": 909725576, "process_rss_bytes": 9839935488}, "peak_prefill_memory": null, "peak_decode_memory": 6923108216, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "5ff9eec84b479180cc771b15d683184131094a132cb3edc87caeef285e56096e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13358 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "9ba26f538448fc25e6b077ac", "attempt_id": "54df6d79e0c5", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:35.404074Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.29408385985066055, "origin_tokens": 1741, "compressed_tokens": 610, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1741, "source_tokens_receiver": 1741, "query_tokens": 713, "message_tokens": 610, "message_utf8_bytes": 2227, "cache_tensor_bytes": null, "serialized_payload_bytes": 2227, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 132.59024999570101, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.07254188507795, "ttft_ms": 14.472457929514349, "decode_ms": 69.4129589246586}, "total_wall_ms": 166.226250003092, "ttft_ms": 14.472457929514349, "input_usage": {"receiver_prompt_tokens": 713}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 9839935488, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6923108216, "mlx_cache_bytes": 909725576, "process_rss_bytes": 9839935488}, "peak_prefill_memory": null, "peak_decode_memory": 6923108216, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "89. 3122", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "5ff9eec84b479180cc771b15d683184131094a132cb3edc87caeef285e56096e", "output_hash": "9b72a5068196d31468c2f7467ca0b8b8801150b4c9a72ca9432036e36791bfe2"} | |
| 13359 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "565191a3b8d09fdf24e3f48e", "attempt_id": "704a858b8a4e", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:35.591665Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.29408385985066055, "origin_tokens": 1741, "compressed_tokens": 610, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1741, "source_tokens_receiver": 1741, "query_tokens": 709, "message_tokens": 610, "message_utf8_bytes": 2227, "cache_tensor_bytes": null, "serialized_payload_bytes": 2227, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 132.59024999570101, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.01699990220368, "ttft_ms": 13.653417001478374, "decode_ms": 82.77883299160749}, "total_wall_ms": 178.81191603373736, "ttft_ms": 13.653417001478374, "input_usage": {"receiver_prompt_tokens": 709}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 9839935488, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6921289576, "mlx_cache_bytes": 909725576, "process_rss_bytes": 9839935488}, "peak_prefill_memory": null, "peak_decode_memory": 6921289576, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Wilhelmina Dubrovnik", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "5ff9eec84b479180cc771b15d683184131094a132cb3edc87caeef285e56096e", "output_hash": "f42f05ebfc96f7258cbfbbb37cd65e114d3d15f869e68e6c95b71fc288c30a32"} | |
| 13360 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "ca34e6c6deeac90a15e97aa4", "attempt_id": "936bd9e5ea62", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:35.792878Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.29408385985066055, "origin_tokens": 1741, "compressed_tokens": 610, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1741, "source_tokens_receiver": 1741, "query_tokens": 718, "message_tokens": 610, "message_utf8_bytes": 2227, "cache_tensor_bytes": null, "serialized_payload_bytes": 2227, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 132.59024999570101, "decode_payload_ms": 0.0, "receiver_prefill_ms": 82.49204105231911, "ttft_ms": 13.704000040888786, "decode_ms": 27.36558299511671}, "total_wall_ms": 124.84249996487051, "ttft_ms": 13.704000040888786, "input_usage": {"receiver_prompt_tokens": 718}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 9839935488, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6926303116, "mlx_cache_bytes": 1337334460, "process_rss_bytes": 9839935488}, "peak_prefill_memory": null, "peak_decode_memory": 6926303116, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "725 EUR", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "5ff9eec84b479180cc771b15d683184131094a132cb3edc87caeef285e56096e", "output_hash": "d85375dd97abd95564a909c90ac971b79b2e3762a41def5871d5ca6734672cde"} | |
| 13361 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "bf7753afe9d2b4a86c0fd377", "attempt_id": "d132d0711ad7", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:36.355334Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09124933166993406, "origin_tokens": 5611, "compressed_tokens": 594, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5611, "source_tokens_receiver": 5611, "query_tokens": 692, "message_tokens": 594, "message_utf8_bytes": 2928, "cache_tensor_bytes": null, "serialized_payload_bytes": 2928, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 412.7760409610346, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.34087501093745, "ttft_ms": 13.54212500154972, "decode_ms": 81.27537497784942}, "total_wall_ms": 177.56204202305526, "ttft_ms": 13.54212500154972, "input_usage": {"receiver_prompt_tokens": 692}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 9839919104, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6911835940, "mlx_cache_bytes": 501908516, "process_rss_bytes": 9839919104}, "peak_prefill_memory": null, "peak_decode_memory": 6911835940, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lithmunpra-16", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "2f4ee550cc74023c50f425edfedc7505ba10b7380173105284a8c21d9f1c7e38", "output_hash": "26fc169ceaba84d7f292defd76062949b1b87a9a87be89b5c857b8642cc75061"} | |
| 13362 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "59b4b3a5fada3de4dcff75c6", "attempt_id": "3dea41b30390", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:36.560880Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09124933166993406, "origin_tokens": 5611, "compressed_tokens": 594, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5611, "source_tokens_receiver": 5611, "query_tokens": 697, "message_tokens": 594, "message_utf8_bytes": 2928, "cache_tensor_bytes": null, "serialized_payload_bytes": 2928, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 412.7760409610346, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.4879999961704, "ttft_ms": 13.52029200643301, "decode_ms": 80.69570793304592}, "total_wall_ms": 177.01116704847664, "ttft_ms": 13.52029200643301, "input_usage": {"receiver_prompt_tokens": 697}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 9839935488, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6913834808, "mlx_cache_bytes": 891047684, "process_rss_bytes": 9839935488}, "peak_prefill_memory": null, "peak_decode_memory": 6913834808, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lithwenmel-12", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "2f4ee550cc74023c50f425edfedc7505ba10b7380173105284a8c21d9f1c7e38", "output_hash": "49cf3f58cd63c02c44a8005ad5268d67c15d58ba53b9dd350b3a4150d539e1fd"} | |
| 13363 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "6178c5b32e5c1c795720503f", "attempt_id": "9c48efc6fc12", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:36.765604Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09124933166993406, "origin_tokens": 5611, "compressed_tokens": 594, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5611, "source_tokens_receiver": 5611, "query_tokens": 696, "message_tokens": 594, "message_utf8_bytes": 2928, "cache_tensor_bytes": null, "serialized_payload_bytes": 2928, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 412.7760409610346, "decode_payload_ms": 0.0, "receiver_prefill_ms": 80.87954099755734, "ttft_ms": 13.772791950032115, "decode_ms": 13.41762498486787}, "total_wall_ms": 109.40745798870921, "ttft_ms": 13.772791950032115, "input_usage": {"receiver_prompt_tokens": 696}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9839935488, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6913834808, "mlx_cache_bytes": 891047684, "process_rss_bytes": 9839935488}, "peak_prefill_memory": null, "peak_decode_memory": 6913834808, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "2f4ee550cc74023c50f425edfedc7505ba10b7380173105284a8c21d9f1c7e38", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13364 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "acf337f1bdd849663bf8fae4", "attempt_id": "a4ea8b3156e7", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:36.902434Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09124933166993406, "origin_tokens": 5611, "compressed_tokens": 594, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5611, "source_tokens_receiver": 5611, "query_tokens": 694, "message_tokens": 594, "message_utf8_bytes": 2928, "cache_tensor_bytes": null, "serialized_payload_bytes": 2928, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 412.7760409610346, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.02004195097834, "ttft_ms": 13.674958958290517, "decode_ms": 13.439708040095866}, "total_wall_ms": 109.42087497096509, "ttft_ms": 13.674958958290517, "input_usage": {"receiver_prompt_tokens": 694}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9839935488, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6912589624, "mlx_cache_bytes": 1027297028, "process_rss_bytes": 9839935488}, "peak_prefill_memory": null, "peak_decode_memory": 6912589624, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "2f4ee550cc74023c50f425edfedc7505ba10b7380173105284a8c21d9f1c7e38", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13365 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "e7a22aa9cb81134f4adc40ad", "attempt_id": "5973e5869f92", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:37.038581Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09124933166993406, "origin_tokens": 5611, "compressed_tokens": 594, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5611, "source_tokens_receiver": 5611, "query_tokens": 701, "message_tokens": 594, "message_utf8_bytes": 2928, "cache_tensor_bytes": null, "serialized_payload_bytes": 2928, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 412.7760409610346, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.8092079134658, "ttft_ms": 13.614792027510703, "decode_ms": 13.366665923967957}, "total_wall_ms": 110.06366601213813, "ttft_ms": 13.614792027510703, "input_usage": {"receiver_prompt_tokens": 701}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9839935488, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6916652872, "mlx_cache_bytes": 1444977140, "process_rss_bytes": 9839935488}, "peak_prefill_memory": null, "peak_decode_memory": 6916652872, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "2f4ee550cc74023c50f425edfedc7505ba10b7380173105284a8c21d9f1c7e38", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13366 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "350bc555103428082d3925a8", "attempt_id": "faa784f6279a", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:37.942924Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.047451343836886005, "origin_tokens": 10790, "compressed_tokens": 524, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10790, "source_tokens_receiver": 10790, "query_tokens": 623, "message_tokens": 524, "message_utf8_bytes": 2629, "cache_tensor_bytes": null, "serialized_payload_bytes": 2629, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 763.3149999892339, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.93025006260723, "ttft_ms": 13.506458955816925, "decode_ms": 13.53600004222244}, "total_wall_ms": 103.25541696511209, "ttft_ms": 13.506458955816925, "input_usage": {"receiver_prompt_tokens": 623}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840017408, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6871547408, "mlx_cache_bytes": 460489488, "process_rss_bytes": 9840017408}, "peak_prefill_memory": null, "peak_decode_memory": 6871547408, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "d0e66bf1e934fdda4ef50f32f3b6818e97e0088725056daad0e120c3a39a244c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13367 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "74535baea19cc629bdbbd597", "attempt_id": "7c306b9b0d1f", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:38.081486Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.047451343836886005, "origin_tokens": 10790, "compressed_tokens": 524, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10790, "source_tokens_receiver": 10790, "query_tokens": 630, "message_tokens": 524, "message_utf8_bytes": 2629, "cache_tensor_bytes": null, "serialized_payload_bytes": 2629, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 763.3149999892339, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.61358402017504, "ttft_ms": 13.45079205930233, "decode_ms": 13.561500003561378}, "total_wall_ms": 103.83587493561208, "ttft_ms": 13.45079205930233, "input_usage": {"receiver_prompt_tokens": 630}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840033792, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6875299372, "mlx_cache_bytes": 835652836, "process_rss_bytes": 9840033792}, "peak_prefill_memory": null, "peak_decode_memory": 6875299372, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "d0e66bf1e934fdda4ef50f32f3b6818e97e0088725056daad0e120c3a39a244c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13368 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "9dfd27fcbd6406e46fa26495", "attempt_id": "0fd9d738b657", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:38.220060Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.047451343836886005, "origin_tokens": 10790, "compressed_tokens": 524, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10790, "source_tokens_receiver": 10790, "query_tokens": 628, "message_tokens": 524, "message_utf8_bytes": 2629, "cache_tensor_bytes": null, "serialized_payload_bytes": 2629, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 763.3149999892339, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.93670901749283, "ttft_ms": 13.974540983326733, "decode_ms": 13.573957956396043}, "total_wall_ms": 103.84933289606124, "ttft_ms": 13.974540983326733, "input_usage": {"receiver_prompt_tokens": 628}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840033792, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6874938924, "mlx_cache_bytes": 958926052, "process_rss_bytes": 9840033792}, "peak_prefill_memory": null, "peak_decode_memory": 6874938924, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "d0e66bf1e934fdda4ef50f32f3b6818e97e0088725056daad0e120c3a39a244c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13369 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "e28eff027b0f6afda3f4a72c", "attempt_id": "93df50c4abdf", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:38.358185Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.047451343836886005, "origin_tokens": 10790, "compressed_tokens": 524, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10790, "source_tokens_receiver": 10790, "query_tokens": 624, "message_tokens": 524, "message_utf8_bytes": 2629, "cache_tensor_bytes": null, "serialized_payload_bytes": 2629, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 763.3149999892339, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.70149989239872, "ttft_ms": 13.344959006644785, "decode_ms": 13.604625011794269}, "total_wall_ms": 102.87079203408211, "ttft_ms": 13.344959006644785, "input_usage": {"receiver_prompt_tokens": 624}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840033792, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6871924268, "mlx_cache_bytes": 1142754532, "process_rss_bytes": 9840033792}, "peak_prefill_memory": null, "peak_decode_memory": 6871924268, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "d0e66bf1e934fdda4ef50f32f3b6818e97e0088725056daad0e120c3a39a244c", "output_hash": "b764cdc0eab7137467211272fa539f1260d1bf2e71bcf6ff3bdc960f5c16aa14"} | |
| 13370 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "1c918eaec76830ba78cf2371", "attempt_id": "7377a7076671", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:38.495544Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.047451343836886005, "origin_tokens": 10790, "compressed_tokens": 524, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10790, "source_tokens_receiver": 10790, "query_tokens": 633, "message_tokens": 524, "message_utf8_bytes": 2629, "cache_tensor_bytes": null, "serialized_payload_bytes": 2629, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 763.3149999892339, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.71449992246926, "ttft_ms": 13.53616698179394, "decode_ms": 13.394333887845278}, "total_wall_ms": 104.24224997404963, "ttft_ms": 13.53616698179394, "input_usage": {"receiver_prompt_tokens": 633}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840033792, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6876741176, "mlx_cache_bytes": 1496110788, "process_rss_bytes": 9840033792}, "peak_prefill_memory": null, "peak_decode_memory": 6876741176, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "d0e66bf1e934fdda4ef50f32f3b6818e97e0088725056daad0e120c3a39a244c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13371 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "eb64745c5f6d6f799b99d649", "attempt_id": "145c5d2a602b", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:38.770719Z", "task_family": "synthetic", "document_id": "syn_03018_2000", "document_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03018_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2887760857304005, "origin_tokens": 1783, "compressed_tokens": 612, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1773, "source_tokens_receiver": 1773, "query_tokens": 708, "message_tokens": 610, "message_utf8_bytes": 2127, "cache_tensor_bytes": null, "serialized_payload_bytes": 2127, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 133.36312491446733, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.30666706711054, "ttft_ms": 13.794000027701259, "decode_ms": 93.79004093352705}, "total_wall_ms": 190.17916708253324, "ttft_ms": 13.794000027701259, "input_usage": {"receiver_prompt_tokens": 708}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 9840017408, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6921109348, "mlx_cache_bytes": 511444068, "process_rss_bytes": 9840017408}, "peak_prefill_memory": null, "peak_decode_memory": 6921109348, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "SL-13P-4841", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03018_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "d79910d4ccd929e27a520bda24364730d36c6e4d3cf9750954807cf1b9ef70e5", "output_hash": "86d74277112be603caee39e722d1da2de1ddedf93b74b26bb742e3f437da2193"} | |
| 13372 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "0955af517b4308d51156895a", "attempt_id": "7773592558b1", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:38.983448Z", "task_family": "synthetic", "document_id": "syn_03018_2000", "document_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03018_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2887760857304005, "origin_tokens": 1783, "compressed_tokens": 612, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1773, "source_tokens_receiver": 1773, "query_tokens": 714, "message_tokens": 610, "message_utf8_bytes": 2127, "cache_tensor_bytes": null, "serialized_payload_bytes": 2127, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 133.36312491446733, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.05954108759761, "ttft_ms": 13.46366701181978, "decode_ms": 121.3793329661712}, "total_wall_ms": 217.1675420831889, "ttft_ms": 13.46366701181978, "input_usage": {"receiver_prompt_tokens": 714}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 9840033792, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6924484476, "mlx_cache_bytes": 937168776, "process_rss_bytes": 9840033792}, "peak_prefill_memory": null, "peak_decode_memory": 6924484476, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 951-P, Gaspé.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03018_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.28571428571428575}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "d79910d4ccd929e27a520bda24364730d36c6e4d3cf9750954807cf1b9ef70e5", "output_hash": "8b7e0edb9b534e12b8d9c8efa4240c2479f9f53dd4387d847d38dab5f30fe569"} | |
| 13373 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "78840ccee53685c10f1f8f6c", "attempt_id": "e69cb8e40dc5", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:39.222790Z", "task_family": "synthetic", "document_id": "syn_03018_2000", "document_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03018_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2887760857304005, "origin_tokens": 1783, "compressed_tokens": 612, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1773, "source_tokens_receiver": 1773, "query_tokens": 713, "message_tokens": 610, "message_utf8_bytes": 2127, "cache_tensor_bytes": null, "serialized_payload_bytes": 2127, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 133.36312491446733, "decode_payload_ms": 0.0, "receiver_prefill_ms": 80.43666707817465, "ttft_ms": 13.499000109732151, "decode_ms": 67.28566705714911}, "total_wall_ms": 162.4609159771353, "ttft_ms": 13.499000109732151, "input_usage": {"receiver_prompt_tokens": 713}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 9840033792, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6924189564, "mlx_cache_bytes": 937168776, "process_rss_bytes": 9840033792}, "peak_prefill_memory": null, "peak_decode_memory": 6924189564, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "77. 6813", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03018_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "d79910d4ccd929e27a520bda24364730d36c6e4d3cf9750954807cf1b9ef70e5", "output_hash": "c4e0ad5c4e7cb95c9eaa9154c193a2aa34c479871a18231c1780014122c1b113"} | |
| 13374 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "1c6664eff8569b8bfb993601", "attempt_id": "2f669423d858", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:39.407233Z", "task_family": "synthetic", "document_id": "syn_03018_2000", "document_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03018_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2887760857304005, "origin_tokens": 1783, "compressed_tokens": 612, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1773, "source_tokens_receiver": 1773, "query_tokens": 710, "message_tokens": 610, "message_utf8_bytes": 2127, "cache_tensor_bytes": null, "serialized_payload_bytes": 2127, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 133.36312491446733, "decode_payload_ms": 0.0, "receiver_prefill_ms": 80.95870888791978, "ttft_ms": 13.677624985575676, "decode_ms": 26.942666969262064}, "total_wall_ms": 122.73366702720523, "ttft_ms": 13.677624985575676, "input_usage": {"receiver_prompt_tokens": 710}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 9840033792, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6921666428, "mlx_cache_bytes": 1146359688, "process_rss_bytes": 9840033792}, "peak_prefill_memory": null, "peak_decode_memory": 6921666428, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Unknown.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03018_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "d79910d4ccd929e27a520bda24364730d36c6e4d3cf9750954807cf1b9ef70e5", "output_hash": "9cf9f50925b2a7803c73826a305235d4215dc428721c731072a9f2c0f5d6ae5a"} | |
| 13375 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "0e36f93333055935ed3a0b15", "attempt_id": "84724efd2a45", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:39.551928Z", "task_family": "synthetic", "document_id": "syn_03018_2000", "document_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03018_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2887760857304005, "origin_tokens": 1783, "compressed_tokens": 612, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1773, "source_tokens_receiver": 1773, "query_tokens": 718, "message_tokens": 610, "message_utf8_bytes": 2127, "cache_tensor_bytes": null, "serialized_payload_bytes": 2127, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 133.36312491446733, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.2665419653058, "ttft_ms": 13.670040993019938, "decode_ms": 68.10116593260318}, "total_wall_ms": 164.26904092077166, "ttft_ms": 13.670040993019938, "input_usage": {"receiver_prompt_tokens": 718}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 9840033792, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6926303116, "mlx_cache_bytes": 1547426492, "process_rss_bytes": 9840033792}, "peak_prefill_memory": null, "peak_decode_memory": 6926303116, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7,296,125", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03018_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "d79910d4ccd929e27a520bda24364730d36c6e4d3cf9750954807cf1b9ef70e5", "output_hash": "8b531ccf7fd3b97bf2ef32627da2617b8353e5c2dd09a274017a5a5a868bdcdb"} | |
| 13376 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "eec4b7a254cbd2d30a6783d0", "attempt_id": "8edb991c97ca", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:40.153398Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09131442839308009, "origin_tokens": 5607, "compressed_tokens": 608, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5607, "source_tokens_receiver": 5607, "query_tokens": 707, "message_tokens": 608, "message_utf8_bytes": 2904, "cache_tensor_bytes": null, "serialized_payload_bytes": 2904, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 411.6947080474347, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.3903339440003, "ttft_ms": 13.688875013031065, "decode_ms": 13.582292012870312}, "total_wall_ms": 110.0582079961896, "ttft_ms": 13.688875013031065, "input_usage": {"receiver_prompt_tokens": 707}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840033792, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6920028000, "mlx_cache_bytes": 510346336, "process_rss_bytes": 9840033792}, "peak_prefill_memory": null, "peak_decode_memory": 6920028000, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "fcedf0dfa4477545dc403e957b9900c03632fd942a1c89dd753c42bd466437ca", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13377 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "0c18c1d4feaba1ffd4d078de", "attempt_id": "92d6862a9ad7", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:40.291822Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09131442839308009, "origin_tokens": 5607, "compressed_tokens": 608, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5607, "source_tokens_receiver": 5607, "query_tokens": 711, "message_tokens": 608, "message_utf8_bytes": 2904, "cache_tensor_bytes": null, "serialized_payload_bytes": 2904, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 411.6947080474347, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.43854199443012, "ttft_ms": 13.52491695433855, "decode_ms": 121.32429203484207}, "total_wall_ms": 217.58012496866286, "ttft_ms": 13.52491695433855, "input_usage": {"receiver_prompt_tokens": 711}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 9840050176, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6922551152, "mlx_cache_bytes": 907841400, "process_rss_bytes": 9840050176}, "peak_prefill_memory": null, "peak_decode_memory": 6922551152, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 69-B, La Tuque.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.888888888888889}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "fcedf0dfa4477545dc403e957b9900c03632fd942a1c89dd753c42bd466437ca", "output_hash": "ae102defa198878a85f267bb05366209b7afd2e13fade185988545130aed376c"} | |
| 13378 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "6776ca83fee28a29a164da74", "attempt_id": "b3bf81b0ecc2", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:40.536822Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09131442839308009, "origin_tokens": 5607, "compressed_tokens": 608, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5607, "source_tokens_receiver": 5607, "query_tokens": 711, "message_tokens": 608, "message_utf8_bytes": 2904, "cache_tensor_bytes": null, "serialized_payload_bytes": 2904, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 411.6947080474347, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.26370795071125, "ttft_ms": 13.698415947146714, "decode_ms": 13.371917069889605}, "total_wall_ms": 109.61904202122241, "ttft_ms": 13.698415947146714, "input_usage": {"receiver_prompt_tokens": 711}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840050176, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6922551152, "mlx_cache_bytes": 907841400, "process_rss_bytes": 9840050176}, "peak_prefill_memory": null, "peak_decode_memory": 6922551152, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "fcedf0dfa4477545dc403e957b9900c03632fd942a1c89dd753c42bd466437ca", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13379 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "2b67176dae86f76ce0847c5c", "attempt_id": "9382e579ed87", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:40.673608Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09131442839308009, "origin_tokens": 5607, "compressed_tokens": 608, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5607, "source_tokens_receiver": 5607, "query_tokens": 707, "message_tokens": 608, "message_utf8_bytes": 2904, "cache_tensor_bytes": null, "serialized_payload_bytes": 2904, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 411.6947080474347, "decode_payload_ms": 0.0, "receiver_prefill_ms": 80.69295901805162, "ttft_ms": 13.776125037111342, "decode_ms": 27.38616697024554}, "total_wall_ms": 123.14591591712087, "ttft_ms": 13.776125037111342, "input_usage": {"receiver_prompt_tokens": 707}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 9840050176, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6920028000, "mlx_cache_bytes": 907841400, "process_rss_bytes": 9840050176}, "peak_prefill_memory": null, "peak_decode_memory": 6920028000, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Unknown.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "fcedf0dfa4477545dc403e957b9900c03632fd942a1c89dd753c42bd466437ca", "output_hash": "9cf9f50925b2a7803c73826a305235d4215dc428721c731072a9f2c0f5d6ae5a"} | |
| 13380 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "a7a907c5abbd9b9f9954beb1", "attempt_id": "d0e2b9e0ac6e", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:40.825307Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09131442839308009, "origin_tokens": 5607, "compressed_tokens": 608, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5607, "source_tokens_receiver": 5607, "query_tokens": 713, "message_tokens": 608, "message_utf8_bytes": 2904, "cache_tensor_bytes": null, "serialized_payload_bytes": 2904, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 411.6947080474347, "decode_payload_ms": 0.0, "receiver_prefill_ms": 80.62379201874137, "ttft_ms": 13.540875050239265, "decode_ms": 13.613624963909388}, "total_wall_ms": 109.08341594040394, "ttft_ms": 13.540875050239265, "input_usage": {"receiver_prompt_tokens": 713}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840050176, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6923108216, "mlx_cache_bytes": 1117821592, "process_rss_bytes": 9840050176}, "peak_prefill_memory": null, "peak_decode_memory": 6923108216, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "fcedf0dfa4477545dc403e957b9900c03632fd942a1c89dd753c42bd466437ca", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13381 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "bdc304a5ce47b37598ed4b90", "attempt_id": "97d359b69125", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:41.731025Z", "task_family": "synthetic", "document_id": "syn_03020_16000", "document_hash": "4b594f32d4e18cae34a0b4b72741bb2f8306989a08d8989ff4a6fe026f126b6d", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03020_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.0475218117690737, "origin_tokens": 10774, "compressed_tokens": 535, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10774, "source_tokens_receiver": 10774, "query_tokens": 632, "message_tokens": 535, "message_utf8_bytes": 2602, "cache_tensor_bytes": null, "serialized_payload_bytes": 2602, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 765.4559169895947, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.07566704973578, "ttft_ms": 13.83874996099621, "decode_ms": 13.782207970507443}, "total_wall_ms": 105.04250007215887, "ttft_ms": 13.83874996099621, "input_usage": {"receiver_prompt_tokens": 632}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840082944, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6876560948, "mlx_cache_bytes": 465650484, "process_rss_bytes": 9840082944}, "peak_prefill_memory": null, "peak_decode_memory": 6876560948, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03020_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "f278e598c7c8cba1ccac8187739c3b358b734c4a95dfdb9fb8240164af4d8835", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13382 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "3dfaf34171b6bbc6fe8c5f4a", "attempt_id": "46f933511a89", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:41.871952Z", "task_family": "synthetic", "document_id": "syn_03020_16000", "document_hash": "4b594f32d4e18cae34a0b4b72741bb2f8306989a08d8989ff4a6fe026f126b6d", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03020_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.0475218117690737, "origin_tokens": 10774, "compressed_tokens": 535, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10774, "source_tokens_receiver": 10774, "query_tokens": 638, "message_tokens": 535, "message_utf8_bytes": 2602, "cache_tensor_bytes": null, "serialized_payload_bytes": 2602, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 765.4559169895947, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.07850001659244, "ttft_ms": 13.680667034350336, "decode_ms": 13.399334042333066}, "total_wall_ms": 104.42070907447487, "ttft_ms": 13.680667034350336, "input_usage": {"receiver_prompt_tokens": 638}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840099328, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6879936076, "mlx_cache_bytes": 845581608, "process_rss_bytes": 9840099328}, "peak_prefill_memory": null, "peak_decode_memory": 6879936076, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03020_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "f278e598c7c8cba1ccac8187739c3b358b734c4a95dfdb9fb8240164af4d8835", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13383 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "b1f5bd797c82c66557b10698", "attempt_id": "85e64fe881ea", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:42.011122Z", "task_family": "synthetic", "document_id": "syn_03020_16000", "document_hash": "4b594f32d4e18cae34a0b4b72741bb2f8306989a08d8989ff4a6fe026f126b6d", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03020_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.0475218117690737, "origin_tokens": 10774, "compressed_tokens": 535, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10774, "source_tokens_receiver": 10774, "query_tokens": 639, "message_tokens": 535, "message_utf8_bytes": 2602, "cache_tensor_bytes": null, "serialized_payload_bytes": 2602, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 765.4559169895947, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.12862507812679, "ttft_ms": 13.579874997958541, "decode_ms": 13.42275005299598}, "total_wall_ms": 104.38249993603677, "ttft_ms": 13.579874997958541, "input_usage": {"receiver_prompt_tokens": 639}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840099328, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6880820816, "mlx_cache_bytes": 1140102944, "process_rss_bytes": 9840099328}, "peak_prefill_memory": null, "peak_decode_memory": 6880820816, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03020_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "f278e598c7c8cba1ccac8187739c3b358b734c4a95dfdb9fb8240164af4d8835", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13384 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "e3545ff828f6c43eee55b12f", "attempt_id": "c6afac65dd0c", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:42.150237Z", "task_family": "synthetic", "document_id": "syn_03020_16000", "document_hash": "4b594f32d4e18cae34a0b4b72741bb2f8306989a08d8989ff4a6fe026f126b6d", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03020_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.0475218117690737, "origin_tokens": 10774, "compressed_tokens": 535, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10774, "source_tokens_receiver": 10774, "query_tokens": 635, "message_tokens": 535, "message_utf8_bytes": 2602, "cache_tensor_bytes": null, "serialized_payload_bytes": 2602, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 765.4559169895947, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.50033391453326, "ttft_ms": 13.583875028416514, "decode_ms": 26.827708003111184}, "total_wall_ms": 117.1373330289498, "ttft_ms": 13.583875028416514, "input_usage": {"receiver_prompt_tokens": 635}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 9840099328, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6910164556, "mlx_cache_bytes": 1366071072, "process_rss_bytes": 9840099328}, "peak_prefill_memory": null, "peak_decode_memory": 6910164556, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Unknown.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03020_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "f278e598c7c8cba1ccac8187739c3b358b734c4a95dfdb9fb8240164af4d8835", "output_hash": "9cf9f50925b2a7803c73826a305235d4215dc428721c731072a9f2c0f5d6ae5a"} | |
| 13385 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "347ee16e10550ea5a10084be", "attempt_id": "86b2638ff588", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:42.301738Z", "task_family": "synthetic", "document_id": "syn_03020_16000", "document_hash": "4b594f32d4e18cae34a0b4b72741bb2f8306989a08d8989ff4a6fe026f126b6d", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03020_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.0475218117690737, "origin_tokens": 10774, "compressed_tokens": 535, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10774, "source_tokens_receiver": 10774, "query_tokens": 643, "message_tokens": 535, "message_utf8_bytes": 2602, "cache_tensor_bytes": null, "serialized_payload_bytes": 2602, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 765.4559169895947, "decode_payload_ms": 0.0, "receiver_prefill_ms": 78.93879094626755, "ttft_ms": 13.547459035180509, "decode_ms": 13.596541015431285}, "total_wall_ms": 107.32608300168067, "ttft_ms": 13.547459035180509, "input_usage": {"receiver_prompt_tokens": 643}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840099328, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6882934368, "mlx_cache_bytes": 1749082408, "process_rss_bytes": 9840099328}, "peak_prefill_memory": null, "peak_decode_memory": 6882934368, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03020_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "f278e598c7c8cba1ccac8187739c3b358b734c4a95dfdb9fb8240164af4d8835", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13386 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "fab1b06d5b196b857bcabde2", "attempt_id": "6fed38d99b2f", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:42.579859Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.29681159420289854, "origin_tokens": 1725, "compressed_tokens": 611, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1725, "source_tokens_receiver": 1725, "query_tokens": 708, "message_tokens": 611, "message_utf8_bytes": 2218, "cache_tensor_bytes": null, "serialized_payload_bytes": 2218, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 132.24212499335408, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.44983393140137, "ttft_ms": 13.77808302640915, "decode_ms": 80.717624980025}, "total_wall_ms": 177.26650007534772, "ttft_ms": 13.77808302640915, "input_usage": {"receiver_prompt_tokens": 708}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 9840099328, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6921109348, "mlx_cache_bytes": 511444068, "process_rss_bytes": 9840099328}, "peak_prefill_memory": null, "peak_decode_memory": 6921109348, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "-49S-8868", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "4195cfbc0a9206cfd90ead6cc7bf27b83d2fb3f4410726e38af66ba3aab5c1f7", "output_hash": "b3088a5962a1da8d5dd2c274e8b89ca473ed861e1a5632decf895b279b3cf828"} | |
| 13387 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "23216966b836b6f50224d27f", "attempt_id": "532ae6c71afc", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:42.779809Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.29681159420289854, "origin_tokens": 1725, "compressed_tokens": 611, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1725, "source_tokens_receiver": 1725, "query_tokens": 714, "message_tokens": 611, "message_utf8_bytes": 2218, "cache_tensor_bytes": null, "serialized_payload_bytes": 2218, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 132.24212499335408, "decode_payload_ms": 0.0, "receiver_prefill_ms": 80.85654198657721, "ttft_ms": 13.590832939371467, "decode_ms": 13.501083012670279}, "total_wall_ms": 109.21716596931219, "ttft_ms": 13.590832939371467, "input_usage": {"receiver_prompt_tokens": 714}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840115712, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6924484476, "mlx_cache_bytes": 937168776, "process_rss_bytes": 9840115712}, "peak_prefill_memory": null, "peak_decode_memory": 6924484476, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "4195cfbc0a9206cfd90ead6cc7bf27b83d2fb3f4410726e38af66ba3aab5c1f7", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13388 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "9c722ce4605d9ebeab9eb0d7", "attempt_id": "3158292a711a", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:42.911050Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.29681159420289854, "origin_tokens": 1725, "compressed_tokens": 611, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1725, "source_tokens_receiver": 1725, "query_tokens": 714, "message_tokens": 611, "message_utf8_bytes": 2218, "cache_tensor_bytes": null, "serialized_payload_bytes": 2218, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 132.24212499335408, "decode_payload_ms": 0.0, "receiver_prefill_ms": 80.71325009223074, "ttft_ms": 13.654708047397435, "decode_ms": 53.93966694828123}, "total_wall_ms": 149.54354206565768, "ttft_ms": 13.654708047397435, "input_usage": {"receiver_prompt_tokens": 714}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 9840115712, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6924484476, "mlx_cache_bytes": 937168776, "process_rss_bytes": 9840115712}, "peak_prefill_memory": null, "peak_decode_memory": 6924484476, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "70.4868", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "4195cfbc0a9206cfd90ead6cc7bf27b83d2fb3f4410726e38af66ba3aab5c1f7", "output_hash": "3206dbd8e13578fb94e0e033d60c7739a36853f2fc9dc1b4fc6d96c771480b14"} | |
| 13389 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "effbfb4e433ed1baf6af4ced", "attempt_id": "2df527bc67e8", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:43.082619Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.29681159420289854, "origin_tokens": 1725, "compressed_tokens": 611, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1725, "source_tokens_receiver": 1725, "query_tokens": 711, "message_tokens": 611, "message_utf8_bytes": 2218, "cache_tensor_bytes": null, "serialized_payload_bytes": 2218, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 132.24212499335408, "decode_payload_ms": 0.0, "receiver_prefill_ms": 80.49529197160155, "ttft_ms": 13.652167050167918, "decode_ms": 53.80370910279453}, "total_wall_ms": 149.24495795276016, "ttft_ms": 13.652167050167918, "input_usage": {"receiver_prompt_tokens": 711}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 9840115712, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6899957616, "mlx_cache_bytes": 1124781960, "process_rss_bytes": 9840115712}, "peak_prefill_memory": null, "peak_decode_memory": 6899957616, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Ingrid Mbeki", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "4195cfbc0a9206cfd90ead6cc7bf27b83d2fb3f4410726e38af66ba3aab5c1f7", "output_hash": "1dbd85090bb65fb3b72de8ca4ce32f2c234729ff4a239274e79fb574b800a79d"} | |
| 13390 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "901b6641282f37e5cdbab32b", "attempt_id": "813289ac8753", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:43.253909Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.29681159420289854, "origin_tokens": 1725, "compressed_tokens": 611, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1725, "source_tokens_receiver": 1725, "query_tokens": 718, "message_tokens": 611, "message_utf8_bytes": 2218, "cache_tensor_bytes": null, "serialized_payload_bytes": 2218, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 132.24212499335408, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.26120897941291, "ttft_ms": 13.597709010355175, "decode_ms": 67.73312494624406}, "total_wall_ms": 163.84679195471108, "ttft_ms": 13.597709010355175, "input_usage": {"receiver_prompt_tokens": 718}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 9840115712, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6926303116, "mlx_cache_bytes": 1525848764, "process_rss_bytes": 9840115712}, "peak_prefill_memory": null, "peak_decode_memory": 6926303116, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1,505,050", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "4195cfbc0a9206cfd90ead6cc7bf27b83d2fb3f4410726e38af66ba3aab5c1f7", "output_hash": "ce50815ff9cdaab72b318f821f80a5ad96dc257c6df51048d6fd9c743b4157c6"} | |
| 13391 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "d73dcf2106d17b17875c7f69", "attempt_id": "29e62f496d18", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:43.853733Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09102222222222223, "origin_tokens": 5625, "compressed_tokens": 628, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5625, "source_tokens_receiver": 5625, "query_tokens": 725, "message_tokens": 628, "message_utf8_bytes": 2932, "cache_tensor_bytes": null, "serialized_payload_bytes": 2932, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 410.2218330372125, "decode_payload_ms": 0.0, "receiver_prefill_ms": 82.5124999973923, "ttft_ms": 13.566624955274165, "decode_ms": 13.57391697820276}, "total_wall_ms": 111.0671660862863, "ttft_ms": 13.566624955274165, "input_usage": {"receiver_prompt_tokens": 725}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840099328, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6930562984, "mlx_cache_bytes": 521176232, "process_rss_bytes": 9840099328}, "peak_prefill_memory": null, "peak_decode_memory": 6930562984, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "3cf767abb031e398a10755b8979a1e61a3c6597c3dd32313883b75d396397f64", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13392 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "f9d9537981975c1e42bd69bb", "attempt_id": "27e0cb456fc3", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:43.993289Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09102222222222223, "origin_tokens": 5625, "compressed_tokens": 628, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5625, "source_tokens_receiver": 5625, "query_tokens": 732, "message_tokens": 628, "message_utf8_bytes": 2932, "cache_tensor_bytes": null, "serialized_payload_bytes": 2932, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 410.2218330372125, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.60216698888689, "ttft_ms": 13.518957886844873, "decode_ms": 81.08383300714195}, "total_wall_ms": 177.55912500433624, "ttft_ms": 13.518957886844873, "input_usage": {"receiver_prompt_tokens": 732}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 9840115712, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6935019460, "mlx_cache_bytes": 957730836, "process_rss_bytes": 9840115712}, "peak_prefill_memory": null, "peak_decode_memory": 6935019460, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Rouyn-Noranda", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.4}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "3cf767abb031e398a10755b8979a1e61a3c6597c3dd32313883b75d396397f64", "output_hash": "af7f83537a0d3375a2abccf86d8e250ff5970a50cb182a500cd005d4cdfa06a3"} | |
| 13393 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "eda2d175c11ed45d2b94e4d8", "attempt_id": "12334f2b344b", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:44.198190Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09102222222222223, "origin_tokens": 5625, "compressed_tokens": 628, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5625, "source_tokens_receiver": 5625, "query_tokens": 733, "message_tokens": 628, "message_utf8_bytes": 2932, "cache_tensor_bytes": null, "serialized_payload_bytes": 2932, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 410.2218330372125, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.5901670139283, "ttft_ms": 13.704749988391995, "decode_ms": 13.565000030212104}, "total_wall_ms": 110.18908303231001, "ttft_ms": 13.704749988391995, "input_usage": {"receiver_prompt_tokens": 733}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840115712, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6935199688, "mlx_cache_bytes": 1101650820, "process_rss_bytes": 9840115712}, "peak_prefill_memory": null, "peak_decode_memory": 6935199688, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "3cf767abb031e398a10755b8979a1e61a3c6597c3dd32313883b75d396397f64", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13394 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "e769fff4227bf9eea45e0c9b", "attempt_id": "7fb0a56ec809", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:44.335930Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09102222222222223, "origin_tokens": 5625, "compressed_tokens": 628, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5625, "source_tokens_receiver": 5625, "query_tokens": 727, "message_tokens": 628, "message_utf8_bytes": 2932, "cache_tensor_bytes": null, "serialized_payload_bytes": 2932, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 410.2218330372125, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.42683398909867, "ttft_ms": 13.72387504670769, "decode_ms": 13.445000047795475}, "total_wall_ms": 109.91854197345674, "ttft_ms": 13.72387504670769, "input_usage": {"receiver_prompt_tokens": 727}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840115712, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6931824580, "mlx_cache_bytes": 1508088708, "process_rss_bytes": 9840115712}, "peak_prefill_memory": null, "peak_decode_memory": 6931824580, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "3cf767abb031e398a10755b8979a1e61a3c6597c3dd32313883b75d396397f64", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13395 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "fa00eff2ebbad0463be910ab", "attempt_id": "5704098f0db9", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:44.472916Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09102222222222223, "origin_tokens": 5625, "compressed_tokens": 628, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5625, "source_tokens_receiver": 5625, "query_tokens": 738, "message_tokens": 628, "message_utf8_bytes": 2932, "cache_tensor_bytes": null, "serialized_payload_bytes": 2932, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 410.2218330372125, "decode_payload_ms": 0.0, "receiver_prefill_ms": 82.87045895121992, "ttft_ms": 13.720500050112605, "decode_ms": 13.567875022999942}, "total_wall_ms": 111.536749987863, "ttft_ms": 13.720500050112605, "input_usage": {"receiver_prompt_tokens": 738}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840115712, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6938394588, "mlx_cache_bytes": 1948116744, "process_rss_bytes": 9840115712}, "peak_prefill_memory": null, "peak_decode_memory": 6938394588, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "3cf767abb031e398a10755b8979a1e61a3c6597c3dd32313883b75d396397f64", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13396 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "07c032e0befd2132ef85e93f", "attempt_id": "d3dbff34e485", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:45.380855Z", "task_family": "synthetic", "document_id": "syn_03023_16000", "document_hash": "6dcdc8a309dbe960e69546d93eb8d8bf0eda3b871dc830f6e35fde9329c07fc4", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03023_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.04825636192271442, "origin_tokens": 10618, "compressed_tokens": 527, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10610, "source_tokens_receiver": 10610, "query_tokens": 626, "message_tokens": 527, "message_utf8_bytes": 2594, "cache_tensor_bytes": null, "serialized_payload_bytes": 2594, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 764.2882500076666, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.5418750923127, "ttft_ms": 13.63354199565947, "decode_ms": 13.568541966378689}, "total_wall_ms": 104.01291691232473, "ttft_ms": 13.63354199565947, "input_usage": {"receiver_prompt_tokens": 626}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840164864, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6873480732, "mlx_cache_bytes": 462471964, "process_rss_bytes": 9840164864}, "peak_prefill_memory": null, "peak_decode_memory": 6873480732, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03023_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "cc31dfd4d29db2c64647304bbf99a4cd6578b571b4dfab52569d21c71c81fdd0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13397 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "d5fad0f0a6e6d0961266728b", "attempt_id": "980a9a1680d8", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:45.520010Z", "task_family": "synthetic", "document_id": "syn_03023_16000", "document_hash": "6dcdc8a309dbe960e69546d93eb8d8bf0eda3b871dc830f6e35fde9329c07fc4", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03023_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.04825636192271442, "origin_tokens": 10618, "compressed_tokens": 527, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10610, "source_tokens_receiver": 10610, "query_tokens": 631, "message_tokens": 527, "message_utf8_bytes": 2594, "cache_tensor_bytes": null, "serialized_payload_bytes": 2594, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 764.2882500076666, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.67095791455358, "ttft_ms": 13.434540946036577, "decode_ms": 215.58258403092623}, "total_wall_ms": 305.9170419583097, "ttft_ms": 13.434540946036577, "input_usage": {"receiver_prompt_tokens": 631}, "output_usage": {"output_tokens": 16}, "provider_cached_usage": null, "process_memory": 9840181248, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6876184112, "mlx_cache_bytes": 815238388, "process_rss_bytes": 9840181248}, "peak_prefill_memory": null, "peak_decode_memory": 6876184112, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Quimunker-11, Lot 121-Z, Ostkovar-7", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03023_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.25}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "cc31dfd4d29db2c64647304bbf99a4cd6578b571b4dfab52569d21c71c81fdd0", "output_hash": "26f171295680c488e81308be2f8f0ccde5c0cb82445171d2b8785b6533db2faf"} | |
| 13398 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "8868a9d73cd11f98f84393d3", "attempt_id": "a9686c9b36d6", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:45.860320Z", "task_family": "synthetic", "document_id": "syn_03023_16000", "document_hash": "6dcdc8a309dbe960e69546d93eb8d8bf0eda3b871dc830f6e35fde9329c07fc4", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03023_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.04825636192271442, "origin_tokens": 10618, "compressed_tokens": 527, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10610, "source_tokens_receiver": 10610, "query_tokens": 629, "message_tokens": 527, "message_utf8_bytes": 2594, "cache_tensor_bytes": null, "serialized_payload_bytes": 2594, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 764.2882500076666, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.51062502898276, "ttft_ms": 13.47187499050051, "decode_ms": 13.528166920877993}, "total_wall_ms": 103.7569169420749, "ttft_ms": 13.47187499050051, "input_usage": {"receiver_prompt_tokens": 629}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840181248, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6906723888, "mlx_cache_bytes": 977374452, "process_rss_bytes": 9840181248}, "peak_prefill_memory": null, "peak_decode_memory": 6906723888, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03023_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "cc31dfd4d29db2c64647304bbf99a4cd6578b571b4dfab52569d21c71c81fdd0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13399 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "c1b713f73c5b32b4b85c7099", "attempt_id": "557cd2947c62", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:45.998490Z", "task_family": "synthetic", "document_id": "syn_03023_16000", "document_hash": "6dcdc8a309dbe960e69546d93eb8d8bf0eda3b871dc830f6e35fde9329c07fc4", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03023_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.04825636192271442, "origin_tokens": 10618, "compressed_tokens": 527, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10610, "source_tokens_receiver": 10610, "query_tokens": 625, "message_tokens": 527, "message_utf8_bytes": 2594, "cache_tensor_bytes": null, "serialized_payload_bytes": 2594, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 764.2882500076666, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.79341689031571, "ttft_ms": 13.578291982412338, "decode_ms": 26.8278339644894}, "total_wall_ms": 116.4377920795232, "ttft_ms": 13.578291982412338, "input_usage": {"receiver_prompt_tokens": 625}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 9840181248, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6873480732, "mlx_cache_bytes": 977374452, "process_rss_bytes": 9840181248}, "peak_prefill_memory": null, "peak_decode_memory": 6873480732, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Unknown.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03023_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "cc31dfd4d29db2c64647304bbf99a4cd6578b571b4dfab52569d21c71c81fdd0", "output_hash": "9cf9f50925b2a7803c73826a305235d4215dc428721c731072a9f2c0f5d6ae5a"} | |
| 13400 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "50c366e1940ab9177e170227", "attempt_id": "615744cfd9d5", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:46.149325Z", "task_family": "synthetic", "document_id": "syn_03023_16000", "document_hash": "6dcdc8a309dbe960e69546d93eb8d8bf0eda3b871dc830f6e35fde9329c07fc4", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03023_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.04825636192271442, "origin_tokens": 10618, "compressed_tokens": 527, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10610, "source_tokens_receiver": 10610, "query_tokens": 634, "message_tokens": 527, "message_utf8_bytes": 2594, "cache_tensor_bytes": null, "serialized_payload_bytes": 2594, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 764.2882500076666, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.95170801505446, "ttft_ms": 13.488249969668686, "decode_ms": 13.649209053255618}, "total_wall_ms": 104.28883298300207, "ttft_ms": 13.488249969668686, "input_usage": {"receiver_prompt_tokens": 634}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840181248, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6878117436, "mlx_cache_bytes": 1355421400, "process_rss_bytes": 9840181248}, "peak_prefill_memory": null, "peak_decode_memory": 6878117436, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03023_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "cc31dfd4d29db2c64647304bbf99a4cd6578b571b4dfab52569d21c71c81fdd0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13401 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "590e0dcd056deeac7cb8819e", "attempt_id": "0cbe0c361ee0", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:46.424841Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.27932351336606653, "origin_tokens": 1833, "compressed_tokens": 613, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1833, "source_tokens_receiver": 1833, "query_tokens": 711, "message_tokens": 613, "message_utf8_bytes": 2142, "cache_tensor_bytes": null, "serialized_payload_bytes": 2142, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 133.4354169666767, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.97245805058628, "ttft_ms": 13.667916995473206, "decode_ms": 94.47820798959583}, "total_wall_ms": 191.3930419832468, "ttft_ms": 13.667916995473206, "input_usage": {"receiver_prompt_tokens": 711}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 9840164864, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6922551152, "mlx_cache_bytes": 512935024, "process_rss_bytes": 9840164864}, "peak_prefill_memory": null, "peak_decode_memory": 6922551152, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "SL-19R-1587", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "d78d8dace006e33e059a919ff31b33bf55d5af65c2d11a526374f38be78a09f7", "output_hash": "ec443ee9d09f3481154034f1fcaa81f8a0ac5dfe9dc889f6ac12c061317d403c"} | |
| 13402 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "cc6825c8811e73c8e6d65563", "attempt_id": "292c9f6deb2c", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:46.638766Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.27932351336606653, "origin_tokens": 1833, "compressed_tokens": 613, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1833, "source_tokens_receiver": 1833, "query_tokens": 716, "message_tokens": 613, "message_utf8_bytes": 2142, "cache_tensor_bytes": null, "serialized_payload_bytes": 2142, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 133.4354169666767, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.31883305031806, "ttft_ms": 13.571374933235347, "decode_ms": 108.38358395267278}, "total_wall_ms": 204.60933295544237, "ttft_ms": 13.571374933235347, "input_usage": {"receiver_prompt_tokens": 716}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 9840181248, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6925746052, "mlx_cache_bytes": 939954076, "process_rss_bytes": 9840181248}, "peak_prefill_memory": null, "peak_decode_memory": 6925746052, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 134-P, Amos.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "d78d8dace006e33e059a919ff31b33bf55d5af65c2d11a526374f38be78a09f7", "output_hash": "deaa4a7027da752c9df504fa0aa3bf6e95e67899555e909632c92824be0f9222"} | |
| 13403 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "adefa2deecab0081dc78dc53", "attempt_id": "114f1b594e70", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:46.864841Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.27932351336606653, "origin_tokens": 1833, "compressed_tokens": 613, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1833, "source_tokens_receiver": 1833, "query_tokens": 716, "message_tokens": 613, "message_utf8_bytes": 2142, "cache_tensor_bytes": null, "serialized_payload_bytes": 2142, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 133.4354169666767, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.01712504867464, "ttft_ms": 13.389915926381946, "decode_ms": 13.874542084522545}, "total_wall_ms": 109.49125001206994, "ttft_ms": 13.389915926381946, "input_usage": {"receiver_prompt_tokens": 716}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840181248, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6925746052, "mlx_cache_bytes": 939954076, "process_rss_bytes": 9840181248}, "peak_prefill_memory": null, "peak_decode_memory": 6925746052, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "d78d8dace006e33e059a919ff31b33bf55d5af65c2d11a526374f38be78a09f7", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13404 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "58209169f68cce43a488d550", "attempt_id": "360df5b252f5", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:46.996633Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.27932351336606653, "origin_tokens": 1833, "compressed_tokens": 613, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1833, "source_tokens_receiver": 1833, "query_tokens": 711, "message_tokens": 613, "message_utf8_bytes": 2142, "cache_tensor_bytes": null, "serialized_payload_bytes": 2142, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 133.4354169666767, "decode_payload_ms": 0.0, "receiver_prefill_ms": 80.81633294932544, "ttft_ms": 13.509792042896152, "decode_ms": 81.05787495151162}, "total_wall_ms": 176.611041999422, "ttft_ms": 13.509792042896152, "input_usage": {"receiver_prompt_tokens": 711}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 9840181248, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6922551152, "mlx_cache_bytes": 939954076, "process_rss_bytes": 9840181248}, "peak_prefill_memory": null, "peak_decode_memory": 6922551152, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Ouellet-Marchand", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.6666666666666666}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "d78d8dace006e33e059a919ff31b33bf55d5af65c2d11a526374f38be78a09f7", "output_hash": "1229d1ed4affff1edfd9decf0ca81f0878696c321c9db8e985142b3abb89f8b7"} | |
| 13405 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "7feaa039484ead467810eeeb", "attempt_id": "45e210854b45", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:47.194608Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.27932351336606653, "origin_tokens": 1833, "compressed_tokens": 613, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1833, "source_tokens_receiver": 1833, "query_tokens": 718, "message_tokens": 613, "message_utf8_bytes": 2142, "cache_tensor_bytes": null, "serialized_payload_bytes": 2142, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 133.4354169666767, "decode_payload_ms": 0.0, "receiver_prefill_ms": 80.99699998274446, "ttft_ms": 13.48858408164233, "decode_ms": 27.141917031258345}, "total_wall_ms": 122.85466690082103, "ttft_ms": 13.48858408164233, "input_usage": {"receiver_prompt_tokens": 718}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 9840181248, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6926303116, "mlx_cache_bytes": 1151507152, "process_rss_bytes": 9840181248}, "peak_prefill_memory": null, "peak_decode_memory": 6926303116, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "480 CAD", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "d78d8dace006e33e059a919ff31b33bf55d5af65c2d11a526374f38be78a09f7", "output_hash": "2b805cb377c063cf2055242d5de3dd1126def1234967fc60006e24b1b06b332a"} | |
| 13406 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "9abd11c3b8ac762fb4bb75f2", "attempt_id": "c95270b3fdf8", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:47.759295Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.0908768193113241, "origin_tokens": 5634, "compressed_tokens": 617, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5634, "source_tokens_receiver": 5634, "query_tokens": 715, "message_tokens": 617, "message_utf8_bytes": 2952, "cache_tensor_bytes": null, "serialized_payload_bytes": 2952, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 416.9149580411613, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.61091699730605, "ttft_ms": 13.524874928407371, "decode_ms": 94.51966593042016}, "total_wall_ms": 191.04845798574388, "ttft_ms": 13.524874928407371, "input_usage": {"receiver_prompt_tokens": 715}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 9840164864, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6924664704, "mlx_cache_bytes": 515114112, "process_rss_bytes": 9840164864}, "peak_prefill_memory": null, "peak_decode_memory": 6924664704, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "NG-69D-5055", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "404b731a8575063a81e5e38e8bd821338f027d573652e3ec80b60b986ff7abbd", "output_hash": "2ad4f1f569357ac4cbdf0624ef9ad5e94d4a7d597c597837c734d5d4da55d0dd"} | |
| 13407 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "dfafe2afd8b8c3933079e24d", "attempt_id": "ea911f021807", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:47.978105Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.0908768193113241, "origin_tokens": 5634, "compressed_tokens": 617, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5634, "source_tokens_receiver": 5634, "query_tokens": 720, "message_tokens": 617, "message_utf8_bytes": 2952, "cache_tensor_bytes": null, "serialized_payload_bytes": 2952, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 416.9149580411613, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.44462504424155, "ttft_ms": 13.576624915003777, "decode_ms": 121.90050003118813}, "total_wall_ms": 218.31916691735387, "ttft_ms": 13.576624915003777, "input_usage": {"receiver_prompt_tokens": 720}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 9840181248, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6927564692, "mlx_cache_bytes": 917475260, "process_rss_bytes": 9840181248}, "peak_prefill_memory": null, "peak_decode_memory": 6927564692, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Schefferville, Lot 522-C", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "404b731a8575063a81e5e38e8bd821338f027d573652e3ec80b60b986ff7abbd", "output_hash": "8e230870319ae61dbdfd5664ec2b1ed39a40ec61b8edf5980da3d84c1a655882"} | |
| 13408 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "2bfbcfde3c00851ac6db3c78", "attempt_id": "eee2405e7716", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:48.223802Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.0908768193113241, "origin_tokens": 5634, "compressed_tokens": 617, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5634, "source_tokens_receiver": 5634, "query_tokens": 721, "message_tokens": 617, "message_utf8_bytes": 2952, "cache_tensor_bytes": null, "serialized_payload_bytes": 2952, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 416.9149580411613, "decode_payload_ms": 0.0, "receiver_prefill_ms": 80.92516707256436, "ttft_ms": 13.54108308441937, "decode_ms": 13.529791962355375}, "total_wall_ms": 109.31995802093297, "ttft_ms": 13.54108308441937, "input_usage": {"receiver_prompt_tokens": 721}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840181248, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6927744920, "mlx_cache_bytes": 1059035900, "process_rss_bytes": 9840181248}, "peak_prefill_memory": null, "peak_decode_memory": 6927744920, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "404b731a8575063a81e5e38e8bd821338f027d573652e3ec80b60b986ff7abbd", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13409 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "8f892761583dac6eaf692f56", "attempt_id": "855900478aca", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:48.360660Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.0908768193113241, "origin_tokens": 5634, "compressed_tokens": 617, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5634, "source_tokens_receiver": 5634, "query_tokens": 717, "message_tokens": 617, "message_utf8_bytes": 2952, "cache_tensor_bytes": null, "serialized_payload_bytes": 2952, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 416.9149580411613, "decode_payload_ms": 0.0, "receiver_prefill_ms": 80.48191701527685, "ttft_ms": 13.454459025524557, "decode_ms": 13.507333002053201}, "total_wall_ms": 108.67391701322049, "ttft_ms": 13.454459025524557, "input_usage": {"receiver_prompt_tokens": 717}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840181248, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6903119752, "mlx_cache_bytes": 1248221948, "process_rss_bytes": 9840181248}, "peak_prefill_memory": null, "peak_decode_memory": 6903119752, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "404b731a8575063a81e5e38e8bd821338f027d573652e3ec80b60b986ff7abbd", "output_hash": "b764cdc0eab7137467211272fa539f1260d1bf2e71bcf6ff3bdc960f5c16aa14"} | |
| 13410 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "31db8a6ee0f7ffb829495fc3", "attempt_id": "c51a665ae542", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:48.496460Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.0908768193113241, "origin_tokens": 5634, "compressed_tokens": 617, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5634, "source_tokens_receiver": 5634, "query_tokens": 723, "message_tokens": 617, "message_utf8_bytes": 2952, "cache_tensor_bytes": null, "serialized_payload_bytes": 2952, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 416.9149580411613, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.5575000597164, "ttft_ms": 13.447250006720424, "decode_ms": 13.338083983398974}, "total_wall_ms": 109.6970000071451, "ttft_ms": 13.447250006720424, "input_usage": {"receiver_prompt_tokens": 723}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840181248, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6929301408, "mlx_cache_bytes": 1678911044, "process_rss_bytes": 9840181248}, "peak_prefill_memory": null, "peak_decode_memory": 6929301408, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "404b731a8575063a81e5e38e8bd821338f027d573652e3ec80b60b986ff7abbd", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13411 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "552468de83ad91230b23f29a", "attempt_id": "b1983c75c3a4", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:49.407805Z", "task_family": "synthetic", "document_id": "syn_03026_16000", "document_hash": "16c8741af11a355d207f63d30067b8376744c2d9886524e13f6592b2412b89ce", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03026_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.047311033080761414, "origin_tokens": 10822, "compressed_tokens": 528, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10822, "source_tokens_receiver": 10822, "query_tokens": 626, "message_tokens": 528, "message_utf8_bytes": 2682, "cache_tensor_bytes": null, "serialized_payload_bytes": 2682, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 769.4615829968825, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.80779201816767, "ttft_ms": 13.639832963235676, "decode_ms": 13.537125079892576}, "total_wall_ms": 104.29962491616607, "ttft_ms": 13.639832963235676, "input_usage": {"receiver_prompt_tokens": 626}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840230400, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6873480732, "mlx_cache_bytes": 462471964, "process_rss_bytes": 9840230400}, "peak_prefill_memory": null, "peak_decode_memory": 6873480732, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03026_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "f293cf0e8232489b408513f9199e05af8fe06295b648d7d24435892d46d85598", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13412 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "88b87b2e8feb343a424e8f85", "attempt_id": "804ce772d4fe", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:49.546827Z", "task_family": "synthetic", "document_id": "syn_03026_16000", "document_hash": "16c8741af11a355d207f63d30067b8376744c2d9886524e13f6592b2412b89ce", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03026_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.047311033080761414, "origin_tokens": 10822, "compressed_tokens": 528, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10822, "source_tokens_receiver": 10822, "query_tokens": 631, "message_tokens": 528, "message_utf8_bytes": 2682, "cache_tensor_bytes": null, "serialized_payload_bytes": 2682, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 769.4615829968825, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.55904192849994, "ttft_ms": 13.68779200129211, "decode_ms": 13.602416031062603}, "total_wall_ms": 104.0435410104692, "ttft_ms": 13.68779200129211, "input_usage": {"receiver_prompt_tokens": 631}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840246784, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6876184112, "mlx_cache_bytes": 815238388, "process_rss_bytes": 9840246784}, "peak_prefill_memory": null, "peak_decode_memory": 6876184112, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03026_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "f293cf0e8232489b408513f9199e05af8fe06295b648d7d24435892d46d85598", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13413 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "e896205b2466a75435936a5e", "attempt_id": "88ebb38c1a48", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:49.685085Z", "task_family": "synthetic", "document_id": "syn_03026_16000", "document_hash": "16c8741af11a355d207f63d30067b8376744c2d9886524e13f6592b2412b89ce", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03026_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.047311033080761414, "origin_tokens": 10822, "compressed_tokens": 528, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10822, "source_tokens_receiver": 10822, "query_tokens": 633, "message_tokens": 528, "message_utf8_bytes": 2682, "cache_tensor_bytes": null, "serialized_payload_bytes": 2682, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 769.4615829968825, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.22250001784414, "ttft_ms": 13.600584003143013, "decode_ms": 13.921833015047014}, "total_wall_ms": 103.97058399394155, "ttft_ms": 13.600584003143013, "input_usage": {"receiver_prompt_tokens": 633}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840246784, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6876741176, "mlx_cache_bytes": 1001625300, "process_rss_bytes": 9840246784}, "peak_prefill_memory": null, "peak_decode_memory": 6876741176, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03026_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "f293cf0e8232489b408513f9199e05af8fe06295b648d7d24435892d46d85598", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13414 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "9d24b601a631d76bc7bf716e", "attempt_id": "71ac50df7e4f", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:49.823907Z", "task_family": "synthetic", "document_id": "syn_03026_16000", "document_hash": "16c8741af11a355d207f63d30067b8376744c2d9886524e13f6592b2412b89ce", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03026_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.047311033080761414, "origin_tokens": 10822, "compressed_tokens": 528, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10822, "source_tokens_receiver": 10822, "query_tokens": 627, "message_tokens": 528, "message_utf8_bytes": 2682, "cache_tensor_bytes": null, "serialized_payload_bytes": 2682, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 769.4615829968825, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.89858299959451, "ttft_ms": 13.727667042985559, "decode_ms": 54.534583003260195}, "total_wall_ms": 144.43699992261827, "ttft_ms": 13.727667042985559, "input_usage": {"receiver_prompt_tokens": 627}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 9840246784, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6873660976, "mlx_cache_bytes": 1124701908, "process_rss_bytes": 9840246784}, "peak_prefill_memory": null, "peak_decode_memory": 6873660976, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Mont-Laurier", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03026_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "f293cf0e8232489b408513f9199e05af8fe06295b648d7d24435892d46d85598", "output_hash": "09a3340bff29e5ae0e2d4e8898f50d337fa18c4442051ad06a03107e439c7460"} | |
| 13415 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "d2a837b0d59a420f71b4b02b", "attempt_id": "102dab05b33d", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:50.002221Z", "task_family": "synthetic", "document_id": "syn_03026_16000", "document_hash": "16c8741af11a355d207f63d30067b8376744c2d9886524e13f6592b2412b89ce", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03026_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.047311033080761414, "origin_tokens": 10822, "compressed_tokens": 528, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10822, "source_tokens_receiver": 10822, "query_tokens": 634, "message_tokens": 528, "message_utf8_bytes": 2682, "cache_tensor_bytes": null, "serialized_payload_bytes": 2682, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 769.4615829968825, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.35758293326944, "ttft_ms": 13.893791940063238, "decode_ms": 13.900541933253407}, "total_wall_ms": 105.40545801632106, "ttft_ms": 13.893791940063238, "input_usage": {"receiver_prompt_tokens": 634}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840246784, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6878117436, "mlx_cache_bytes": 1502748856, "process_rss_bytes": 9840246784}, "peak_prefill_memory": null, "peak_decode_memory": 6878117436, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03026_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "f293cf0e8232489b408513f9199e05af8fe06295b648d7d24435892d46d85598", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13416 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "415ef8a2ca423b70bab4c6dd", "attempt_id": "06c92ca9f9a0", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:50.278344Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2909090909090909, "origin_tokens": 1760, "compressed_tokens": 620, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1760, "source_tokens_receiver": 1760, "query_tokens": 717, "message_tokens": 620, "message_utf8_bytes": 2241, "cache_tensor_bytes": null, "serialized_payload_bytes": 2241, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 133.15395906101912, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.66408399119973, "ttft_ms": 13.802708010189235, "decode_ms": 107.78725007548928}, "total_wall_ms": 204.54204198904335, "ttft_ms": 13.802708010189235, "input_usage": {"receiver_prompt_tokens": 717}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 9840263168, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6925926280, "mlx_cache_bytes": 516408456, "process_rss_bytes": 9840263168}, "peak_prefill_memory": null, "peak_decode_memory": 6925926280, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "RQ-10W-4229", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "bb00d1dc7a4c2f147d4b8b46e8ee40800b9d2dce1386ebbc8ae2a3c3d50a3053", "output_hash": "83e9983dc82dee9d853925393e38c21ef13d0e07a7356398b84c1047f4e54bc9"} | |
| 13417 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "88f45c548acb52f6032846e7", "attempt_id": "64af72286413", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:50.504794Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2909090909090909, "origin_tokens": 1760, "compressed_tokens": 620, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1760, "source_tokens_receiver": 1760, "query_tokens": 724, "message_tokens": 620, "message_utf8_bytes": 2241, "cache_tensor_bytes": null, "serialized_payload_bytes": 2241, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 133.15395906101912, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.48041693493724, "ttft_ms": 13.583666062913835, "decode_ms": 13.392750057391822}, "total_wall_ms": 109.70204102341086, "ttft_ms": 13.583666062913835, "input_usage": {"receiver_prompt_tokens": 724}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840279552, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6930382756, "mlx_cache_bytes": 948195284, "process_rss_bytes": 9840279552}, "peak_prefill_memory": null, "peak_decode_memory": 6930382756, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "bb00d1dc7a4c2f147d4b8b46e8ee40800b9d2dce1386ebbc8ae2a3c3d50a3053", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13418 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "9ac5fdd38c2865258867dd73", "attempt_id": "8da4db9e07ad", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:50.637059Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2909090909090909, "origin_tokens": 1760, "compressed_tokens": 620, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1760, "source_tokens_receiver": 1760, "query_tokens": 723, "message_tokens": 620, "message_utf8_bytes": 2241, "cache_tensor_bytes": null, "serialized_payload_bytes": 2241, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 133.15395906101912, "decode_payload_ms": 0.0, "receiver_prefill_ms": 80.24749998003244, "ttft_ms": 13.530500000342727, "decode_ms": 13.438457972370088}, "total_wall_ms": 108.58245892450213, "ttft_ms": 13.530500000342727, "input_usage": {"receiver_prompt_tokens": 723}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840279552, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6906609560, "mlx_cache_bytes": 961515476, "process_rss_bytes": 9840279552}, "peak_prefill_memory": null, "peak_decode_memory": 6906609560, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "15", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "bb00d1dc7a4c2f147d4b8b46e8ee40800b9d2dce1386ebbc8ae2a3c3d50a3053", "output_hash": "e629fa6598d732768f7c726b4b621285f9c3b85303900aa912017db7617d8bdb"} | |
| 13419 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "acdce8f7dda6650c8bbce92b", "attempt_id": "133b97c43fa1", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:50.766855Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2909090909090909, "origin_tokens": 1760, "compressed_tokens": 620, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1760, "source_tokens_receiver": 1760, "query_tokens": 719, "message_tokens": 620, "message_utf8_bytes": 2241, "cache_tensor_bytes": null, "serialized_payload_bytes": 2241, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 133.15395906101912, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.00962510798126, "ttft_ms": 13.431417057290673, "decode_ms": 13.461999944411218}, "total_wall_ms": 109.08183304127306, "ttft_ms": 13.431417057290673, "input_usage": {"receiver_prompt_tokens": 719}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840279552, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6927220644, "mlx_cache_bytes": 1354633172, "process_rss_bytes": 9840279552}, "peak_prefill_memory": null, "peak_decode_memory": 6927220644, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "bb00d1dc7a4c2f147d4b8b46e8ee40800b9d2dce1386ebbc8ae2a3c3d50a3053", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13420 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "8b4d2303b49bbc2c94389cbc", "attempt_id": "bc2a65b7ab54", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:50.897460Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2909090909090909, "origin_tokens": 1760, "compressed_tokens": 620, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1760, "source_tokens_receiver": 1760, "query_tokens": 730, "message_tokens": 620, "message_utf8_bytes": 2241, "cache_tensor_bytes": null, "serialized_payload_bytes": 2241, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 133.15395906101912, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.61275007296354, "ttft_ms": 13.83558299858123, "decode_ms": 13.63058399874717}, "total_wall_ms": 110.37570796906948, "ttft_ms": 13.83558299858123, "input_usage": {"receiver_prompt_tokens": 730}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840279552, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6933757884, "mlx_cache_bytes": 1789893432, "process_rss_bytes": 9840279552}, "peak_prefill_memory": null, "peak_decode_memory": 6933757884, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "535", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "bb00d1dc7a4c2f147d4b8b46e8ee40800b9d2dce1386ebbc8ae2a3c3d50a3053", "output_hash": "20ca98162ba780883712eb701c84e4c06f73aba78e903935a9ad799193b4627f"} | |
| 13421 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "df75aed65d2d24573e12db72", "attempt_id": "cf4e36be305f", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:51.444602Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09139593002499108, "origin_tokens": 5602, "compressed_tokens": 594, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 691, "message_tokens": 594, "message_utf8_bytes": 2869, "cache_tensor_bytes": null, "serialized_payload_bytes": 2869, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 411.21029190253466, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.6205000737682, "ttft_ms": 13.588542002253234, "decode_ms": 13.47133400849998}, "total_wall_ms": 110.09258299600333, "ttft_ms": 13.588542002253234, "input_usage": {"receiver_prompt_tokens": 691}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840263168, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6910754592, "mlx_cache_bytes": 500810784, "process_rss_bytes": 9840263168}, "peak_prefill_memory": null, "peak_decode_memory": 6910754592, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "b01a2c114b7798f1d2dccfa91982bda5e54bbf75797900f644cc8b54e7f78a30", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13422 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "d879ab5f66e28cc486607e50", "attempt_id": "6e850b9994ed", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:51.582725Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09139593002499108, "origin_tokens": 5602, "compressed_tokens": 594, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 697, "message_tokens": 594, "message_utf8_bytes": 2869, "cache_tensor_bytes": null, "serialized_payload_bytes": 2869, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 411.21029190253466, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.25595794990659, "ttft_ms": 13.415624969638884, "decode_ms": 13.44066602177918}, "total_wall_ms": 109.43779197987169, "ttft_ms": 13.415624969638884, "input_usage": {"receiver_prompt_tokens": 697}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840279552, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6913834808, "mlx_cache_bytes": 889949952, "process_rss_bytes": 9840279552}, "peak_prefill_memory": null, "peak_decode_memory": 6913834808, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "b01a2c114b7798f1d2dccfa91982bda5e54bbf75797900f644cc8b54e7f78a30", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13423 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "32762727c79c42ef1195b03e", "attempt_id": "287e38004250", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:51.719351Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09139593002499108, "origin_tokens": 5602, "compressed_tokens": 594, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 696, "message_tokens": 594, "message_utf8_bytes": 2869, "cache_tensor_bytes": null, "serialized_payload_bytes": 2869, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 411.21029190253466, "decode_payload_ms": 0.0, "receiver_prefill_ms": 80.7560000102967, "ttft_ms": 13.496584026142955, "decode_ms": 13.801875058561563}, "total_wall_ms": 109.31887500919402, "ttft_ms": 13.496584026142955, "input_usage": {"receiver_prompt_tokens": 696}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840279552, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6913834808, "mlx_cache_bytes": 889949952, "process_rss_bytes": 9840279552}, "peak_prefill_memory": null, "peak_decode_memory": 6913834808, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "b01a2c114b7798f1d2dccfa91982bda5e54bbf75797900f644cc8b54e7f78a30", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13424 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "3f17ab92dfb53fdef22eb067", "attempt_id": "d54c13be157b", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:51.856534Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09139593002499108, "origin_tokens": 5602, "compressed_tokens": 594, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 693, "message_tokens": 594, "message_utf8_bytes": 2869, "cache_tensor_bytes": null, "serialized_payload_bytes": 2869, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 411.21029190253466, "decode_payload_ms": 0.0, "receiver_prefill_ms": 80.58737497776747, "ttft_ms": 13.507166993804276, "decode_ms": 13.47187499050051}, "total_wall_ms": 108.82874997332692, "ttft_ms": 13.507166993804276, "input_usage": {"receiver_prompt_tokens": 693}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840279552, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6946766648, "mlx_cache_bytes": 1136627456, "process_rss_bytes": 9840279552}, "peak_prefill_memory": null, "peak_decode_memory": 6946766648, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "b01a2c114b7798f1d2dccfa91982bda5e54bbf75797900f644cc8b54e7f78a30", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13425 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "caa8e6401282b1b4b412ef23", "attempt_id": "654c23534fbf", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:51.992501Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09139593002499108, "origin_tokens": 5602, "compressed_tokens": 594, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 701, "message_tokens": 594, "message_utf8_bytes": 2869, "cache_tensor_bytes": null, "serialized_payload_bytes": 2869, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 411.21029190253466, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.33449999149889, "ttft_ms": 13.627209002152085, "decode_ms": 13.453958905301988}, "total_wall_ms": 109.8394999280572, "ttft_ms": 13.627209002152085, "input_usage": {"receiver_prompt_tokens": 701}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840279552, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6916652872, "mlx_cache_bytes": 1554307568, "process_rss_bytes": 9840279552}, "peak_prefill_memory": null, "peak_decode_memory": 6916652872, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "b01a2c114b7798f1d2dccfa91982bda5e54bbf75797900f644cc8b54e7f78a30", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13426 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "a0773860d6fe163f2eb07642", "attempt_id": "7d58e94f7615", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:52.897675Z", "task_family": "synthetic", "document_id": "syn_03029_16000", "document_hash": "33a51b6333419ddfbd88b362df2ee28a833f90300d55ae736740de8a07e5f525", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03029_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.0477211296486159, "origin_tokens": 10729, "compressed_tokens": 541, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10729, "source_tokens_receiver": 10729, "query_tokens": 640, "message_tokens": 541, "message_utf8_bytes": 2573, "cache_tensor_bytes": null, "serialized_payload_bytes": 2573, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 764.4832499790937, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.09095790050924, "ttft_ms": 14.052583021111786, "decode_ms": 13.379666022956371}, "total_wall_ms": 105.83979194052517, "ttft_ms": 14.052583021111786, "input_usage": {"receiver_prompt_tokens": 640}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840279552, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6881197652, "mlx_cache_bytes": 470418260, "process_rss_bytes": 9840279552}, "peak_prefill_memory": null, "peak_decode_memory": 6881197652, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03029_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "9e8ea60b9e3d981f7af1e216df81e2c88d5f6bbb07a84f36cf765c6c9a1535f5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13427 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "6d0b7401ff5de3c44912e118", "attempt_id": "5dadce576c7c", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:53.039116Z", "task_family": "synthetic", "document_id": "syn_03029_16000", "document_hash": "33a51b6333419ddfbd88b362df2ee28a833f90300d55ae736740de8a07e5f525", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03029_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.0477211296486159, "origin_tokens": 10729, "compressed_tokens": 541, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10729, "source_tokens_receiver": 10729, "query_tokens": 645, "message_tokens": 541, "message_utf8_bytes": 2573, "cache_tensor_bytes": null, "serialized_payload_bytes": 2573, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 764.4832499790937, "decode_payload_ms": 0.0, "receiver_prefill_ms": 79.44937492720783, "ttft_ms": 13.580416911281645, "decode_ms": 13.692417065612972}, "total_wall_ms": 108.00554195884615, "ttft_ms": 13.580416911281645, "input_usage": {"receiver_prompt_tokens": 645}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840295936, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6884195944, "mlx_cache_bytes": 854723940, "process_rss_bytes": 9840295936}, "peak_prefill_memory": null, "peak_decode_memory": 6884195944, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03029_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "9e8ea60b9e3d981f7af1e216df81e2c88d5f6bbb07a84f36cf765c6c9a1535f5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13428 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "71653f2116dce73f56b3133b", "attempt_id": "bd74b215c8e3", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:53.181024Z", "task_family": "synthetic", "document_id": "syn_03029_16000", "document_hash": "33a51b6333419ddfbd88b362df2ee28a833f90300d55ae736740de8a07e5f525", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03029_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.0477211296486159, "origin_tokens": 10729, "compressed_tokens": 541, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10729, "source_tokens_receiver": 10729, "query_tokens": 644, "message_tokens": 541, "message_utf8_bytes": 2573, "cache_tensor_bytes": null, "serialized_payload_bytes": 2573, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 764.4832499790937, "decode_payload_ms": 0.0, "receiver_prefill_ms": 79.12958401720971, "ttft_ms": 13.464667019434273, "decode_ms": 13.57449998613447}, "total_wall_ms": 107.42024995852262, "ttft_ms": 13.464667019434273, "input_usage": {"receiver_prompt_tokens": 644}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840295936, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6884195944, "mlx_cache_bytes": 854723940, "process_rss_bytes": 9840295936}, "peak_prefill_memory": null, "peak_decode_memory": 6884195944, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03029_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "9e8ea60b9e3d981f7af1e216df81e2c88d5f6bbb07a84f36cf765c6c9a1535f5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13429 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "e646f5e235bfaf36d20d61ec", "attempt_id": "b9668d454ac2", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:53.324797Z", "task_family": "synthetic", "document_id": "syn_03029_16000", "document_hash": "33a51b6333419ddfbd88b362df2ee28a833f90300d55ae736740de8a07e5f525", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03029_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.0477211296486159, "origin_tokens": 10729, "compressed_tokens": 541, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10729, "source_tokens_receiver": 10729, "query_tokens": 640, "message_tokens": 541, "message_utf8_bytes": 2573, "cache_tensor_bytes": null, "serialized_payload_bytes": 2573, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 764.4832499790937, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.27433398738503, "ttft_ms": 13.488708063960075, "decode_ms": 13.489583972841501}, "total_wall_ms": 104.48366694618016, "ttft_ms": 13.488708063960075, "input_usage": {"receiver_prompt_tokens": 640}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840295936, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6881197652, "mlx_cache_bytes": 854723940, "process_rss_bytes": 9840295936}, "peak_prefill_memory": null, "peak_decode_memory": 6881197652, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03029_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "9e8ea60b9e3d981f7af1e216df81e2c88d5f6bbb07a84f36cf765c6c9a1535f5", "output_hash": "b764cdc0eab7137467211272fa539f1260d1bf2e71bcf6ff3bdc960f5c16aa14"} | |
| 13430 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "e6920a559faecd1e1693aa02", "attempt_id": "123306cfd8c8", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:53.463315Z", "task_family": "synthetic", "document_id": "syn_03029_16000", "document_hash": "33a51b6333419ddfbd88b362df2ee28a833f90300d55ae736740de8a07e5f525", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03029_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.0477211296486159, "origin_tokens": 10729, "compressed_tokens": 541, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10729, "source_tokens_receiver": 10729, "query_tokens": 652, "message_tokens": 541, "message_utf8_bytes": 2573, "cache_tensor_bytes": null, "serialized_payload_bytes": 2573, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 764.4832499790937, "decode_payload_ms": 0.0, "receiver_prefill_ms": 79.59583296906203, "ttft_ms": 13.63545807544142, "decode_ms": 13.57841701246798}, "total_wall_ms": 108.05675003211945, "ttft_ms": 13.63545807544142, "input_usage": {"receiver_prompt_tokens": 652}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840295936, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6888652420, "mlx_cache_bytes": 1243600784, "process_rss_bytes": 9840295936}, "peak_prefill_memory": null, "peak_decode_memory": 6888652420, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03029_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "9e8ea60b9e3d981f7af1e216df81e2c88d5f6bbb07a84f36cf765c6c9a1535f5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13431 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "8d2047b4fa891f00e64a7fbd", "attempt_id": "e86b670f6553", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:53.742013Z", "task_family": "synthetic", "document_id": "syn_03030_2000", "document_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03030_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2910744741330301, "origin_tokens": 1759, "compressed_tokens": 626, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1759, "source_tokens_receiver": 1759, "query_tokens": 725, "message_tokens": 626, "message_utf8_bytes": 2292, "cache_tensor_bytes": null, "serialized_payload_bytes": 2292, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 132.82733398955315, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.78150001913309, "ttft_ms": 13.804542017169297, "decode_ms": 94.61670904420316}, "total_wall_ms": 191.6185829322785, "ttft_ms": 13.804542017169297, "input_usage": {"receiver_prompt_tokens": 725}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 9840279552, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6930562984, "mlx_cache_bytes": 521176232, "process_rss_bytes": 9840279552}, "peak_prefill_memory": null, "peak_decode_memory": 6930562984, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "SA-99X-5582", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03030_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "82285f0e0a4727359abeb71c3bb59cd804e81ee3c25395bf55aea8e271536f03", "output_hash": "418e2d2419844e55a0e0d5a5f62c9bf90dbe137bd83c679e009533943498d1a0"} | |
| 13432 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "b02f8b795691ff5523c0de54", "attempt_id": "7d9c74dbbeb3", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:53.955427Z", "task_family": "synthetic", "document_id": "syn_03030_2000", "document_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03030_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2910744741330301, "origin_tokens": 1759, "compressed_tokens": 626, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1759, "source_tokens_receiver": 1759, "query_tokens": 730, "message_tokens": 626, "message_utf8_bytes": 2292, "cache_tensor_bytes": null, "serialized_payload_bytes": 2292, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 132.82733398955315, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.88349998090416, "ttft_ms": 13.670917018316686, "decode_ms": 107.2561249602586}, "total_wall_ms": 204.09170899074525, "ttft_ms": 13.670917018316686, "input_usage": {"receiver_prompt_tokens": 730}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 9840295936, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6933757884, "mlx_cache_bytes": 956436492, "process_rss_bytes": 9840295936}, "peak_prefill_memory": null, "peak_decode_memory": 6933757884, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Mont-Laurier, Lot 503", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03030_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.5714285714285715}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "82285f0e0a4727359abeb71c3bb59cd804e81ee3c25395bf55aea8e271536f03", "output_hash": "c7998dbe5b8512dd6aced45462e8a59b334a492c931635304a693b390f9d10e7"} | |
| 13433 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "8d5e9e74bb3fcba528caf324", "attempt_id": "a165140f6043", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:54.181538Z", "task_family": "synthetic", "document_id": "syn_03030_2000", "document_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03030_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2910744741330301, "origin_tokens": 1759, "compressed_tokens": 626, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1759, "source_tokens_receiver": 1759, "query_tokens": 728, "message_tokens": 626, "message_utf8_bytes": 2292, "cache_tensor_bytes": null, "serialized_payload_bytes": 2292, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 132.82733398955315, "decode_payload_ms": 0.0, "receiver_prefill_ms": 80.81433305051178, "ttft_ms": 13.572332914918661, "decode_ms": 67.11520894896239}, "total_wall_ms": 162.72391693200916, "ttft_ms": 13.572332914918661, "input_usage": {"receiver_prompt_tokens": 728}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 9840295936, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6909198256, "mlx_cache_bytes": 1088966668, "process_rss_bytes": 9840295936}, "peak_prefill_memory": null, "peak_decode_memory": 6909198256, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4. 8545", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03030_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "82285f0e0a4727359abeb71c3bb59cd804e81ee3c25395bf55aea8e271536f03", "output_hash": "d011ddefade78a099dac57c22a5d63ac79969904e35217daa27e3d85a27a178e"} | |
| 13434 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "22418ac780dfc3d371fba25b", "attempt_id": "e277c2961250", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:54.365993Z", "task_family": "synthetic", "document_id": "syn_03030_2000", "document_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03030_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2910744741330301, "origin_tokens": 1759, "compressed_tokens": 626, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1759, "source_tokens_receiver": 1759, "query_tokens": 724, "message_tokens": 626, "message_utf8_bytes": 2292, "cache_tensor_bytes": null, "serialized_payload_bytes": 2292, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 132.82733398955315, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.25974994618446, "ttft_ms": 13.364500016905367, "decode_ms": 80.36454196553677}, "total_wall_ms": 176.28699995111674, "ttft_ms": 13.364500016905367, "input_usage": {"receiver_prompt_tokens": 724}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 9840295936, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6930562984, "mlx_cache_bytes": 1088966668, "process_rss_bytes": 9840295936}, "peak_prefill_memory": null, "peak_decode_memory": 6930562984, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lorcan Bergström", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03030_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "82285f0e0a4727359abeb71c3bb59cd804e81ee3c25395bf55aea8e271536f03", "output_hash": "5ca17fb7c0572a4d8bdf0553d246da8b09a69151cf9bbab90a1d2f650e36cdea"} | |
| 13435 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "348428fd3f2e94e190d7c271", "attempt_id": "2da0a8ca7a75", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:54.564187Z", "task_family": "synthetic", "document_id": "syn_03030_2000", "document_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03030_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2910744741330301, "origin_tokens": 1759, "compressed_tokens": 626, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1759, "source_tokens_receiver": 1759, "query_tokens": 733, "message_tokens": 626, "message_utf8_bytes": 2292, "cache_tensor_bytes": null, "serialized_payload_bytes": 2292, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 132.82733398955315, "decode_payload_ms": 0.0, "receiver_prefill_ms": 82.11841701995581, "ttft_ms": 13.432541978545487, "decode_ms": 13.475166982971132}, "total_wall_ms": 110.27216596994549, "ttft_ms": 13.432541978545487, "input_usage": {"receiver_prompt_tokens": 733}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840295936, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6935199688, "mlx_cache_bytes": 1498585980, "process_rss_bytes": 9840295936}, "peak_prefill_memory": null, "peak_decode_memory": 6935199688, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03030_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "82285f0e0a4727359abeb71c3bb59cd804e81ee3c25395bf55aea8e271536f03", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13436 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "4bd5b982f0bef2149d25c4f6", "attempt_id": "ef5c762a645d", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:55.112176Z", "task_family": "synthetic", "document_id": "syn_03031_8000", "document_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03031_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09103840682788052, "origin_tokens": 5624, "compressed_tokens": 605, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5624, "source_tokens_receiver": 5624, "query_tokens": 703, "message_tokens": 605, "message_utf8_bytes": 2857, "cache_tensor_bytes": null, "serialized_payload_bytes": 2857, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 410.60670802835375, "decode_payload_ms": 0.0, "receiver_prefill_ms": 82.09837495815009, "ttft_ms": 13.603791943751276, "decode_ms": 13.374999980442226}, "total_wall_ms": 110.42516701854765, "ttft_ms": 13.603791943751276, "input_usage": {"receiver_prompt_tokens": 703}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840279552, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6917914448, "mlx_cache_bytes": 508167248, "process_rss_bytes": 9840279552}, "peak_prefill_memory": null, "peak_decode_memory": 6917914448, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03031_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "1a04f55a1c031973556b715d30bee826838ed1e0da0f915034350eb24c3587a8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13437 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "34df4f63caaedb53e9003e20", "attempt_id": "b0206e3d6787", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:55.250578Z", "task_family": "synthetic", "document_id": "syn_03031_8000", "document_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03031_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09103840682788052, "origin_tokens": 5624, "compressed_tokens": 605, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5624, "source_tokens_receiver": 5624, "query_tokens": 711, "message_tokens": 605, "message_utf8_bytes": 2857, "cache_tensor_bytes": null, "serialized_payload_bytes": 2857, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 410.60670802835375, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.1516250250861, "ttft_ms": 13.49241693969816, "decode_ms": 13.611291069537401}, "total_wall_ms": 109.55529101192951, "ttft_ms": 13.49241693969816, "input_usage": {"receiver_prompt_tokens": 711}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840295936, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6922551152, "mlx_cache_bytes": 931909480, "process_rss_bytes": 9840295936}, "peak_prefill_memory": null, "peak_decode_memory": 6922551152, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03031_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "1a04f55a1c031973556b715d30bee826838ed1e0da0f915034350eb24c3587a8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13438 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "e0589a3cc63113464710c622", "attempt_id": "68479d40a8cc", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:55.387855Z", "task_family": "synthetic", "document_id": "syn_03031_8000", "document_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03031_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09103840682788052, "origin_tokens": 5624, "compressed_tokens": 605, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5624, "source_tokens_receiver": 5624, "query_tokens": 708, "message_tokens": 605, "message_utf8_bytes": 2857, "cache_tensor_bytes": null, "serialized_payload_bytes": 2857, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 410.60670802835375, "decode_payload_ms": 0.0, "receiver_prefill_ms": 80.2339999936521, "ttft_ms": 13.568042078986764, "decode_ms": 26.95983392186463}, "total_wall_ms": 122.05270805861801, "ttft_ms": 13.568042078986764, "input_usage": {"receiver_prompt_tokens": 708}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 9840295936, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6898745188, "mlx_cache_bytes": 1060818792, "process_rss_bytes": 9840295936}, "peak_prefill_memory": null, "peak_decode_memory": 6898745188, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "550.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03031_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "1a04f55a1c031973556b715d30bee826838ed1e0da0f915034350eb24c3587a8", "output_hash": "8ef9519f71b01f3a20b15900f176b5bd2963e361cafa5632e13761f2b93fec57"} | |
| 13439 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "e26d11144c382912cfd419d5", "attempt_id": "13c40d280b96", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:55.537264Z", "task_family": "synthetic", "document_id": "syn_03031_8000", "document_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03031_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09103840682788052, "origin_tokens": 5624, "compressed_tokens": 605, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5624, "source_tokens_receiver": 5624, "query_tokens": 704, "message_tokens": 605, "message_utf8_bytes": 2857, "cache_tensor_bytes": null, "serialized_payload_bytes": 2857, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 410.60670802835375, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.09949994832277, "ttft_ms": 13.580792001448572, "decode_ms": 13.52383301127702}, "total_wall_ms": 109.52062497381121, "ttft_ms": 13.580792001448572, "input_usage": {"receiver_prompt_tokens": 704}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840295936, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6918291312, "mlx_cache_bytes": 1268240232, "process_rss_bytes": 9840295936}, "peak_prefill_memory": null, "peak_decode_memory": 6918291312, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03031_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "1a04f55a1c031973556b715d30bee826838ed1e0da0f915034350eb24c3587a8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13440 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "c3b9617ba6f8944e672432fe", "attempt_id": "3e185cef87b2", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:55.673740Z", "task_family": "synthetic", "document_id": "syn_03031_8000", "document_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03031_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09103840682788052, "origin_tokens": 5624, "compressed_tokens": 605, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5624, "source_tokens_receiver": 5624, "query_tokens": 714, "message_tokens": 605, "message_utf8_bytes": 2857, "cache_tensor_bytes": null, "serialized_payload_bytes": 2857, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 410.60670802835375, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.15383295807987, "ttft_ms": 13.762957998551428, "decode_ms": 13.52870895061642}, "total_wall_ms": 109.80345797725022, "ttft_ms": 13.762957998551428, "input_usage": {"receiver_prompt_tokens": 714}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840295936, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6924484476, "mlx_cache_bytes": 1693964940, "process_rss_bytes": 9840295936}, "peak_prefill_memory": null, "peak_decode_memory": 6924484476, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03031_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "1a04f55a1c031973556b715d30bee826838ed1e0da0f915034350eb24c3587a8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13441 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "96c8f3d79f42c0f8da2767cc", "attempt_id": "1b0d626021f6", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:56.572730Z", "task_family": "synthetic", "document_id": "syn_03032_16000", "document_hash": "7abde11ea4fef3545ad984c522190020d102fc4a8e95736bf23a72a9c7056a78", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03032_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.04742936544696619, "origin_tokens": 10795, "compressed_tokens": 534, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10795, "source_tokens_receiver": 10795, "query_tokens": 633, "message_tokens": 534, "message_utf8_bytes": 2548, "cache_tensor_bytes": null, "serialized_payload_bytes": 2548, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 757.0011669304222, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.74883394408971, "ttft_ms": 13.809875003062189, "decode_ms": 13.460916001349688}, "total_wall_ms": 104.36491610016674, "ttft_ms": 13.809875003062189, "input_usage": {"receiver_prompt_tokens": 633}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840345088, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6876741176, "mlx_cache_bytes": 465847096, "process_rss_bytes": 9840345088}, "peak_prefill_memory": null, "peak_decode_memory": 6876741176, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03032_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "e9359ff81301dc1224342e864670bddf0ecd8796e375f0f38708558da3487f3e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13442 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "ec8b3e3d4e50f6c4112a41ca", "attempt_id": "4856d7a91ad0", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:56.712493Z", "task_family": "synthetic", "document_id": "syn_03032_16000", "document_hash": "7abde11ea4fef3545ad984c522190020d102fc4a8e95736bf23a72a9c7056a78", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03032_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.04742936544696619, "origin_tokens": 10795, "compressed_tokens": 534, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10795, "source_tokens_receiver": 10795, "query_tokens": 638, "message_tokens": 534, "message_utf8_bytes": 2548, "cache_tensor_bytes": null, "serialized_payload_bytes": 2548, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 757.0011669304222, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.27741596661508, "ttft_ms": 13.424583012238145, "decode_ms": 13.462667004205287}, "total_wall_ms": 104.39195798244327, "ttft_ms": 13.424583012238145, "input_usage": {"receiver_prompt_tokens": 638}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840361472, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6879936076, "mlx_cache_bytes": 845778220, "process_rss_bytes": 9840361472}, "peak_prefill_memory": null, "peak_decode_memory": 6879936076, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03032_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "e9359ff81301dc1224342e864670bddf0ecd8796e375f0f38708558da3487f3e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13443 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "eab8c0d14e53e2d3e6cb594e", "attempt_id": "de61e1c747cc", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:56.850947Z", "task_family": "synthetic", "document_id": "syn_03032_16000", "document_hash": "7abde11ea4fef3545ad984c522190020d102fc4a8e95736bf23a72a9c7056a78", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03032_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.04742936544696619, "origin_tokens": 10795, "compressed_tokens": 534, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10795, "source_tokens_receiver": 10795, "query_tokens": 637, "message_tokens": 534, "message_utf8_bytes": 2548, "cache_tensor_bytes": null, "serialized_payload_bytes": 2548, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 757.0011669304222, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.73487493209541, "ttft_ms": 13.475167099386454, "decode_ms": 13.569875038228929}, "total_wall_ms": 104.04175007715821, "ttft_ms": 13.475167099386454, "input_usage": {"receiver_prompt_tokens": 637}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840361472, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6879936076, "mlx_cache_bytes": 845778220, "process_rss_bytes": 9840361472}, "peak_prefill_memory": null, "peak_decode_memory": 6879936076, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03032_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "e9359ff81301dc1224342e864670bddf0ecd8796e375f0f38708558da3487f3e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13444 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "45176195cf630a1b68781bc0", "attempt_id": "a6a2a78a9691", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:56.990724Z", "task_family": "synthetic", "document_id": "syn_03032_16000", "document_hash": "7abde11ea4fef3545ad984c522190020d102fc4a8e95736bf23a72a9c7056a78", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03032_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.04742936544696619, "origin_tokens": 10795, "compressed_tokens": 534, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10795, "source_tokens_receiver": 10795, "query_tokens": 634, "message_tokens": 534, "message_utf8_bytes": 2548, "cache_tensor_bytes": null, "serialized_payload_bytes": 2548, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 757.0011669304222, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.06466708239168, "ttft_ms": 13.43041704967618, "decode_ms": 13.668791041709483}, "total_wall_ms": 104.34995894320309, "ttft_ms": 13.43041704967618, "input_usage": {"receiver_prompt_tokens": 634}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840361472, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6909984332, "mlx_cache_bytes": 1071549740, "process_rss_bytes": 9840361472}, "peak_prefill_memory": null, "peak_decode_memory": 6909984332, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03032_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "e9359ff81301dc1224342e864670bddf0ecd8796e375f0f38708558da3487f3e", "output_hash": "b764cdc0eab7137467211272fa539f1260d1bf2e71bcf6ff3bdc960f5c16aa14"} | |
| 13445 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "25107b9146b5fb08a1f21e9c", "attempt_id": "c09dcb653368", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:57.130217Z", "task_family": "synthetic", "document_id": "syn_03032_16000", "document_hash": "7abde11ea4fef3545ad984c522190020d102fc4a8e95736bf23a72a9c7056a78", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03032_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.04742936544696619, "origin_tokens": 10795, "compressed_tokens": 534, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10795, "source_tokens_receiver": 10795, "query_tokens": 644, "message_tokens": 534, "message_utf8_bytes": 2548, "cache_tensor_bytes": null, "serialized_payload_bytes": 2548, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 757.0011669304222, "decode_payload_ms": 0.0, "receiver_prefill_ms": 79.18929099105299, "ttft_ms": 13.667166931554675, "decode_ms": 13.35033297073096}, "total_wall_ms": 107.51825000625104, "ttft_ms": 13.667166931554675, "input_usage": {"receiver_prompt_tokens": 644}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840361472, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6884015716, "mlx_cache_bytes": 1455658808, "process_rss_bytes": 9840361472}, "peak_prefill_memory": null, "peak_decode_memory": 6884015716, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03032_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "e9359ff81301dc1224342e864670bddf0ecd8796e375f0f38708558da3487f3e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13446 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "6673f3430266f59add09b59b", "attempt_id": "88d527f2ee57", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:57.409417Z", "task_family": "synthetic", "document_id": "syn_03033_2000", "document_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03033_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.29157175398633256, "origin_tokens": 1756, "compressed_tokens": 634, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1756, "source_tokens_receiver": 1756, "query_tokens": 731, "message_tokens": 634, "message_utf8_bytes": 2282, "cache_tensor_bytes": null, "serialized_payload_bytes": 2282, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 132.1765419561416, "decode_payload_ms": 0.0, "receiver_prefill_ms": 82.20633398741484, "ttft_ms": 13.867625035345554, "decode_ms": 108.0306670628488}, "total_wall_ms": 205.42333310004324, "ttft_ms": 13.867625035345554, "input_usage": {"receiver_prompt_tokens": 731}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 9840377856, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6933938112, "mlx_cache_bytes": 524649664, "process_rss_bytes": 9840377856}, "peak_prefill_memory": null, "peak_decode_memory": 6933938112, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "TQ-37Z-3885", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03033_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "22b029412c562f0269a9c337e5e17f9c293f711ba58ff6d0400118c28e909acf", "output_hash": "a9fc9678b963b7c3d6778c275b5aeffc61762adbe622c0b7221038130b0f941f"} | |
| 13447 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "84fc6775e511f25f41d0c97d", "attempt_id": "09718cd158a9", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:57.637531Z", "task_family": "synthetic", "document_id": "syn_03033_2000", "document_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03033_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.29157175398633256, "origin_tokens": 1756, "compressed_tokens": 634, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1756, "source_tokens_receiver": 1756, "query_tokens": 739, "message_tokens": 634, "message_utf8_bytes": 2282, "cache_tensor_bytes": null, "serialized_payload_bytes": 2282, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 132.1765419561416, "decode_payload_ms": 0.0, "receiver_prefill_ms": 82.65445905271918, "ttft_ms": 13.586874934844673, "decode_ms": 13.363665901124477}, "total_wall_ms": 110.88970908895135, "ttft_ms": 13.586874934844673, "input_usage": {"receiver_prompt_tokens": 739}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840394240, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6938574816, "mlx_cache_bytes": 964874312, "process_rss_bytes": 9840394240}, "peak_prefill_memory": null, "peak_decode_memory": 6938574816, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03033_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "22b029412c562f0269a9c337e5e17f9c293f711ba58ff6d0400118c28e909acf", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13448 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "ed0c8821f49c3e9b53552a1d", "attempt_id": "a4385fdffbc9", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:57.770470Z", "task_family": "synthetic", "document_id": "syn_03033_2000", "document_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03033_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.29157175398633256, "origin_tokens": 1756, "compressed_tokens": 634, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1756, "source_tokens_receiver": 1756, "query_tokens": 738, "message_tokens": 634, "message_utf8_bytes": 2282, "cache_tensor_bytes": null, "serialized_payload_bytes": 2282, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 132.1765419561416, "decode_payload_ms": 0.0, "receiver_prefill_ms": 82.50058302655816, "ttft_ms": 13.590125017799437, "decode_ms": 67.3183329636231}, "total_wall_ms": 164.6535419858992, "ttft_ms": 13.590125017799437, "input_usage": {"receiver_prompt_tokens": 738}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 9840394240, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6938574816, "mlx_cache_bytes": 964874312, "process_rss_bytes": 9840394240}, "peak_prefill_memory": null, "peak_decode_memory": 6938574816, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "22. 7060", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03033_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "22b029412c562f0269a9c337e5e17f9c293f711ba58ff6d0400118c28e909acf", "output_hash": "2d4874815c4c532c44367c82f877b61826303a1dc26751e461514ebf534aae65"} | |
| 13449 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "7da3898afc1bf65278c1efcc", "attempt_id": "9d7930936174", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:57.956762Z", "task_family": "synthetic", "document_id": "syn_03033_2000", "document_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03033_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.29157175398633256, "origin_tokens": 1756, "compressed_tokens": 634, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1756, "source_tokens_receiver": 1756, "query_tokens": 734, "message_tokens": 634, "message_utf8_bytes": 2282, "cache_tensor_bytes": null, "serialized_payload_bytes": 2282, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 132.1765419561416, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.90087496768683, "ttft_ms": 13.72554199770093, "decode_ms": 93.89891603495926}, "total_wall_ms": 190.8632500562817, "ttft_ms": 13.72554199770093, "input_usage": {"receiver_prompt_tokens": 734}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 9840394240, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6935576544, "mlx_cache_bytes": 1374883912, "process_rss_bytes": 9840394240}, "peak_prefill_memory": null, "peak_decode_memory": 6935576544, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Nnamdi Baptiste-Roy", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03033_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "22b029412c562f0269a9c337e5e17f9c293f711ba58ff6d0400118c28e909acf", "output_hash": "0828367789e6648fa24fa6e3bfce339a5b9721a26940345b1dc8f263207eb1e6"} | |
| 13450 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "82d80ec090221df4c6f45f72", "attempt_id": "b2f511eb1b27", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:58.169529Z", "task_family": "synthetic", "document_id": "syn_03033_2000", "document_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03033_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.29157175398633256, "origin_tokens": 1756, "compressed_tokens": 634, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1756, "source_tokens_receiver": 1756, "query_tokens": 742, "message_tokens": 634, "message_utf8_bytes": 2282, "cache_tensor_bytes": null, "serialized_payload_bytes": 2282, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 132.1765419561416, "decode_payload_ms": 0.0, "receiver_prefill_ms": 83.1801249878481, "ttft_ms": 13.595332973636687, "decode_ms": 67.58608401287347}, "total_wall_ms": 165.65354203339666, "ttft_ms": 13.595332973636687, "input_usage": {"receiver_prompt_tokens": 742}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 9840394240, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6940213228, "mlx_cache_bytes": 1789369308, "process_rss_bytes": 9840394240}, "peak_prefill_memory": null, "peak_decode_memory": 6940213228, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7,326,886", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03033_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "22b029412c562f0269a9c337e5e17f9c293f711ba58ff6d0400118c28e909acf", "output_hash": "e3010154fffa148727cf0089dd15f522da80a70472d3718942ebc33c8f37eecd"} | |
| 13451 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "1ff1f3a5a37c0a5f2e083441", "attempt_id": "e93e18bad224", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:58.772656Z", "task_family": "synthetic", "document_id": "syn_03034_8000", "document_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03034_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.0899666139518538, "origin_tokens": 5691, "compressed_tokens": 543, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5691, "source_tokens_receiver": 5691, "query_tokens": 642, "message_tokens": 543, "message_utf8_bytes": 2703, "cache_tensor_bytes": null, "serialized_payload_bytes": 2703, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 411.1555829877034, "decode_payload_ms": 0.0, "receiver_prefill_ms": 78.98666604887694, "ttft_ms": 13.581667095422745, "decode_ms": 13.393667060881853}, "total_wall_ms": 107.31004201807082, "ttft_ms": 13.581667095422745, "input_usage": {"receiver_prompt_tokens": 642}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840377856, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6882754140, "mlx_cache_bytes": 472007516, "process_rss_bytes": 9840377856}, "peak_prefill_memory": null, "peak_decode_memory": 6882754140, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03034_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "5f9c29c7db97c77bea62e84bd642f35357ccbbd3384862cb855ef46a2682d7f3", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13452 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "4366064328eb42bfb035109f", "attempt_id": "5461453e1ec0", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:58.908063Z", "task_family": "synthetic", "document_id": "syn_03034_8000", "document_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03034_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.0899666139518538, "origin_tokens": 5691, "compressed_tokens": 543, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5691, "source_tokens_receiver": 5691, "query_tokens": 647, "message_tokens": 543, "message_utf8_bytes": 2703, "cache_tensor_bytes": null, "serialized_payload_bytes": 2703, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 411.1555829877034, "decode_payload_ms": 0.0, "receiver_prefill_ms": 79.00062494445592, "ttft_ms": 13.524458045139909, "decode_ms": 241.64066603407264}, "total_wall_ms": 335.48191690351814, "ttft_ms": 13.524458045139909, "input_usage": {"receiver_prompt_tokens": 647}, "output_usage": {"output_tokens": 18}, "provider_cached_usage": null, "process_memory": 9840394240, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6885457520, "mlx_cache_bytes": 833719668, "process_rss_bytes": 9840394240}, "peak_prefill_memory": null, "peak_decode_memory": 6885457520, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Varostnov-2, BB-41K-8261, Val-d'Or", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03034_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.28571428571428575}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "5f9c29c7db97c77bea62e84bd642f35357ccbbd3384862cb855ef46a2682d7f3", "output_hash": "cbf89dd82f9bbcf3d31d5e1fa64ef45316cdda2a0fd10afc03774e742f42ab5c"} | |
| 13453 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "d643f813deaee081295dfdaa", "attempt_id": "86dc51878d94", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:59.270545Z", "task_family": "synthetic", "document_id": "syn_03034_8000", "document_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03034_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.0899666139518538, "origin_tokens": 5691, "compressed_tokens": 543, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5691, "source_tokens_receiver": 5691, "query_tokens": 647, "message_tokens": 543, "message_utf8_bytes": 2703, "cache_tensor_bytes": null, "serialized_payload_bytes": 2703, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 411.1555829877034, "decode_payload_ms": 0.0, "receiver_prefill_ms": 78.62979196943343, "ttft_ms": 13.567832997068763, "decode_ms": 13.466042000800371}, "total_wall_ms": 106.90404195338488, "ttft_ms": 13.567832997068763, "input_usage": {"receiver_prompt_tokens": 647}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840394240, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6885457520, "mlx_cache_bytes": 833719668, "process_rss_bytes": 9840394240}, "peak_prefill_memory": null, "peak_decode_memory": 6885457520, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03034_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "5f9c29c7db97c77bea62e84bd642f35357ccbbd3384862cb855ef46a2682d7f3", "output_hash": "b764cdc0eab7137467211272fa539f1260d1bf2e71bcf6ff3bdc960f5c16aa14"} | |
| 13454 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "2993c98337989f773738e6d8", "attempt_id": "154bd20eda6b", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:59.405127Z", "task_family": "synthetic", "document_id": "syn_03034_8000", "document_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03034_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.0899666139518538, "origin_tokens": 5691, "compressed_tokens": 543, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5691, "source_tokens_receiver": 5691, "query_tokens": 642, "message_tokens": 543, "message_utf8_bytes": 2703, "cache_tensor_bytes": null, "serialized_payload_bytes": 2703, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 411.1555829877034, "decode_payload_ms": 0.0, "receiver_prefill_ms": 78.65412498358637, "ttft_ms": 13.704583048820496, "decode_ms": 13.473792001605034}, "total_wall_ms": 107.0594999473542, "ttft_ms": 13.704583048820496, "input_usage": {"receiver_prompt_tokens": 642}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840394240, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6882754140, "mlx_cache_bytes": 833719668, "process_rss_bytes": 9840394240}, "peak_prefill_memory": null, "peak_decode_memory": 6882754140, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03034_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "5f9c29c7db97c77bea62e84bd642f35357ccbbd3384862cb855ef46a2682d7f3", "output_hash": "b764cdc0eab7137467211272fa539f1260d1bf2e71bcf6ff3bdc960f5c16aa14"} | |
| 13455 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "11ced7f4f15ccdb8d2d90551", "attempt_id": "73433c4969f3", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:59.539959Z", "task_family": "synthetic", "document_id": "syn_03034_8000", "document_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03034_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.0899666139518538, "origin_tokens": 5691, "compressed_tokens": 543, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5691, "source_tokens_receiver": 5691, "query_tokens": 650, "message_tokens": 543, "message_utf8_bytes": 2703, "cache_tensor_bytes": null, "serialized_payload_bytes": 2703, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 411.1555829877034, "decode_payload_ms": 0.0, "receiver_prefill_ms": 79.2115000076592, "ttft_ms": 13.662290992215276, "decode_ms": 13.317208038643003}, "total_wall_ms": 107.44683304801583, "ttft_ms": 13.662290992215276, "input_usage": {"receiver_prompt_tokens": 650}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840394240, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6887390844, "mlx_cache_bytes": 1221302168, "process_rss_bytes": 9840394240}, "peak_prefill_memory": null, "peak_decode_memory": 6887390844, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03034_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "5f9c29c7db97c77bea62e84bd642f35357ccbbd3384862cb855ef46a2682d7f3", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13456 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "34415a815487c3f8ea0aba3a", "attempt_id": "666812d9ce60", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:42:00.446130Z", "task_family": "synthetic", "document_id": "syn_03035_16000", "document_hash": "064997fa150540eb6684d35dd32131128e1899950cf604209dd972d63383ea1a", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03035_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.04752622296481945, "origin_tokens": 10773, "compressed_tokens": 518, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10773, "source_tokens_receiver": 10773, "query_tokens": 616, "message_tokens": 518, "message_utf8_bytes": 2551, "cache_tensor_bytes": null, "serialized_payload_bytes": 2551, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 767.918833065778, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.965542065911, "ttft_ms": 13.663374935276806, "decode_ms": 13.316750060766935}, "total_wall_ms": 103.2798329833895, "ttft_ms": 13.663374935276806, "input_usage": {"receiver_prompt_tokens": 616}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840427008, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6867287540, "mlx_cache_bytes": 456114932, "process_rss_bytes": 9840427008}, "peak_prefill_memory": null, "peak_decode_memory": 6867287540, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03035_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "65596de1e609ad3b6ebde9d8a67f2bcd2a315249af8ff7c919d2961bf4b6e13e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13457 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "9c2b842082b58863e92c0124", "attempt_id": "c2c8256e1054", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:42:00.584852Z", "task_family": "synthetic", "document_id": "syn_03035_16000", "document_hash": "064997fa150540eb6684d35dd32131128e1899950cf604209dd972d63383ea1a", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03035_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.04752622296481945, "origin_tokens": 10773, "compressed_tokens": 518, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10773, "source_tokens_receiver": 10773, "query_tokens": 624, "message_tokens": 518, "message_utf8_bytes": 2551, "cache_tensor_bytes": null, "serialized_payload_bytes": 2551, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 767.918833065778, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.59683406725526, "ttft_ms": 13.48850002977997, "decode_ms": 13.545625028200448}, "total_wall_ms": 103.9105000672862, "ttft_ms": 13.48850002977997, "input_usage": {"receiver_prompt_tokens": 624}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840443392, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6871924244, "mlx_cache_bytes": 827804848, "process_rss_bytes": 9840443392}, "peak_prefill_memory": null, "peak_decode_memory": 6871924244, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03035_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "65596de1e609ad3b6ebde9d8a67f2bcd2a315249af8ff7c919d2961bf4b6e13e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13458 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "23d066793a5ff3e4390654a0", "attempt_id": "5e0db8bb86e7", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:42:00.723554Z", "task_family": "synthetic", "document_id": "syn_03035_16000", "document_hash": "064997fa150540eb6684d35dd32131128e1899950cf604209dd972d63383ea1a", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03035_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.04752622296481945, "origin_tokens": 10773, "compressed_tokens": 518, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10773, "source_tokens_receiver": 10773, "query_tokens": 622, "message_tokens": 518, "message_utf8_bytes": 2551, "cache_tensor_bytes": null, "serialized_payload_bytes": 2551, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 767.918833065778, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.61066707037389, "ttft_ms": 13.463292038068175, "decode_ms": 13.552790973335505}, "total_wall_ms": 102.7924589579925, "ttft_ms": 13.463292038068175, "input_usage": {"receiver_prompt_tokens": 622}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840443392, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6902070804, "mlx_cache_bytes": 988073136, "process_rss_bytes": 9840443392}, "peak_prefill_memory": null, "peak_decode_memory": 6902070804, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03035_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "65596de1e609ad3b6ebde9d8a67f2bcd2a315249af8ff7c919d2961bf4b6e13e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13459 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "230f9f9aa502a1cffd066da4", "attempt_id": "14cf84a737d9", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:42:00.860715Z", "task_family": "synthetic", "document_id": "syn_03035_16000", "document_hash": "064997fa150540eb6684d35dd32131128e1899950cf604209dd972d63383ea1a", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03035_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.04752622296481945, "origin_tokens": 10773, "compressed_tokens": 518, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10773, "source_tokens_receiver": 10773, "query_tokens": 619, "message_tokens": 518, "message_utf8_bytes": 2551, "cache_tensor_bytes": null, "serialized_payload_bytes": 2551, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 767.918833065778, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.61195799987763, "ttft_ms": 13.43258295673877, "decode_ms": 13.573499978519976}, "total_wall_ms": 102.82150004059076, "ttft_ms": 13.43258295673877, "input_usage": {"receiver_prompt_tokens": 619}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840443392, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6880591380, "mlx_cache_bytes": 1307167920, "process_rss_bytes": 9840443392}, "peak_prefill_memory": null, "peak_decode_memory": 6880591380, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03035_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "65596de1e609ad3b6ebde9d8a67f2bcd2a315249af8ff7c919d2961bf4b6e13e", "output_hash": "b764cdc0eab7137467211272fa539f1260d1bf2e71bcf6ff3bdc960f5c16aa14"} | |
| 13460 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "ed45edebc610decd0462db93", "attempt_id": "43677eef06d7", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:42:00.997723Z", "task_family": "synthetic", "document_id": "syn_03035_16000", "document_hash": "064997fa150540eb6684d35dd32131128e1899950cf604209dd972d63383ea1a", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03035_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.04752622296481945, "origin_tokens": 10773, "compressed_tokens": 518, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10773, "source_tokens_receiver": 10773, "query_tokens": 628, "message_tokens": 518, "message_utf8_bytes": 2551, "cache_tensor_bytes": null, "serialized_payload_bytes": 2551, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 767.918833065778, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.68441692274064, "ttft_ms": 13.642000034451485, "decode_ms": 13.45491607207805}, "total_wall_ms": 104.025415959768, "ttft_ms": 13.642000034451485, "input_usage": {"receiver_prompt_tokens": 628}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840443392, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6874742308, "mlx_cache_bytes": 1681741436, "process_rss_bytes": 9840443392}, "peak_prefill_memory": null, "peak_decode_memory": 6874742308, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03035_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "65596de1e609ad3b6ebde9d8a67f2bcd2a315249af8ff7c919d2961bf4b6e13e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13461 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "ad7326cd51ad89a8ccaed73c", "attempt_id": "b72075a56e1b", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:42:01.272721Z", "task_family": "synthetic", "document_id": "syn_03036_2000", "document_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03036_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2790190735694823, "origin_tokens": 1835, "compressed_tokens": 604, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1835, "source_tokens_receiver": 1835, "query_tokens": 703, "message_tokens": 604, "message_utf8_bytes": 2167, "cache_tensor_bytes": null, "serialized_payload_bytes": 2167, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 132.43970810435712, "decode_payload_ms": 0.0, "receiver_prefill_ms": 82.3544169543311, "ttft_ms": 13.76570900902152, "decode_ms": 13.448833022266626}, "total_wall_ms": 110.8102920698002, "ttft_ms": 13.76570900902152, "input_usage": {"receiver_prompt_tokens": 703}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840427008, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6917914448, "mlx_cache_bytes": 508167248, "process_rss_bytes": 9840427008}, "peak_prefill_memory": null, "peak_decode_memory": 6917914448, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03036_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "5b6ef6e1a7af6965203bd0a141fe23d8c8eee9cf3648a14efe3aba3f808d8eb5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13462 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "33a2029a3a6923165cc17193", "attempt_id": "c080c9cf2660", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:42:01.406221Z", "task_family": "synthetic", "document_id": "syn_03036_2000", "document_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03036_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2790190735694823, "origin_tokens": 1835, "compressed_tokens": 604, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1835, "source_tokens_receiver": 1835, "query_tokens": 708, "message_tokens": 604, "message_utf8_bytes": 2167, "cache_tensor_bytes": null, "serialized_payload_bytes": 2167, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 132.43970810435712, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.16458402946591, "ttft_ms": 13.577790930867195, "decode_ms": 120.93758303672075}, "total_wall_ms": 216.93212504033, "ttft_ms": 13.577790930867195, "input_usage": {"receiver_prompt_tokens": 708}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 9840443392, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6921109348, "mlx_cache_bytes": 930418524, "process_rss_bytes": 9840443392}, "peak_prefill_memory": null, "peak_decode_memory": 6921109348, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 190-P, Schefferville.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03036_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "5b6ef6e1a7af6965203bd0a141fe23d8c8eee9cf3648a14efe3aba3f808d8eb5", "output_hash": "3f4c2bbcf019ff281a0f01052261dbf4d5b100e6919d2ec4ca59a8240615f682"} | |
| 13463 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "96904e3894120bf4b957d830", "attempt_id": "e6fd13850b54", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:42:01.644787Z", "task_family": "synthetic", "document_id": "syn_03036_2000", "document_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03036_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2790190735694823, "origin_tokens": 1835, "compressed_tokens": 604, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1835, "source_tokens_receiver": 1835, "query_tokens": 708, "message_tokens": 604, "message_utf8_bytes": 2167, "cache_tensor_bytes": null, "serialized_payload_bytes": 2167, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 132.43970810435712, "decode_payload_ms": 0.0, "receiver_prefill_ms": 80.72737499605864, "ttft_ms": 13.500292086973786, "decode_ms": 13.433415908366442}, "total_wall_ms": 108.93016611225903, "ttft_ms": 13.500292086973786, "input_usage": {"receiver_prompt_tokens": 708}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840443392, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6921109348, "mlx_cache_bytes": 930418524, "process_rss_bytes": 9840443392}, "peak_prefill_memory": null, "peak_decode_memory": 6921109348, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03036_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "5b6ef6e1a7af6965203bd0a141fe23d8c8eee9cf3648a14efe3aba3f808d8eb5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13464 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "a3ae07fb0684fbf45408e4fa", "attempt_id": "4c529c0d6ba0", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:42:01.775559Z", "task_family": "synthetic", "document_id": "syn_03036_2000", "document_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03036_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2790190735694823, "origin_tokens": 1835, "compressed_tokens": 604, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1835, "source_tokens_receiver": 1835, "query_tokens": 702, "message_tokens": 604, "message_utf8_bytes": 2167, "cache_tensor_bytes": null, "serialized_payload_bytes": 2167, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 132.43970810435712, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.3998329686001, "ttft_ms": 13.618958066217601, "decode_ms": 40.36429105326533}, "total_wall_ms": 136.61749998573214, "ttft_ms": 13.618958066217601, "input_usage": {"receiver_prompt_tokens": 702}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 9840443392, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6952353616, "mlx_cache_bytes": 973508444, "process_rss_bytes": 9840443392}, "peak_prefill_memory": null, "peak_decode_memory": 6952353616, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Zelenko", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03036_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.6666666666666666}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "5b6ef6e1a7af6965203bd0a141fe23d8c8eee9cf3648a14efe3aba3f808d8eb5", "output_hash": "0e887b2fe7a59eb9ea519131c99c3e36e7f42de86c4bb6d35de360846f4b85d8"} | |
| 13465 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "28ec2bc5626824866a8341c3", "attempt_id": "b0c13534b26b", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:42:01.933403Z", "task_family": "synthetic", "document_id": "syn_03036_2000", "document_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03036_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2790190735694823, "origin_tokens": 1835, "compressed_tokens": 604, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1835, "source_tokens_receiver": 1835, "query_tokens": 711, "message_tokens": 604, "message_utf8_bytes": 2167, "cache_tensor_bytes": null, "serialized_payload_bytes": 2167, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 132.43970810435712, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.33633295074105, "ttft_ms": 13.40850000269711, "decode_ms": 13.667750055901706}, "total_wall_ms": 109.67549995984882, "ttft_ms": 13.40850000269711, "input_usage": {"receiver_prompt_tokens": 711}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840443392, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6922551152, "mlx_cache_bytes": 1371003508, "process_rss_bytes": 9840443392}, "peak_prefill_memory": null, "peak_decode_memory": 6922551152, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03036_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "5b6ef6e1a7af6965203bd0a141fe23d8c8eee9cf3648a14efe3aba3f808d8eb5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13466 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "f9a7d2e4c010b4710d085ddb", "attempt_id": "0efddea83706", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:42:02.480643Z", "task_family": "synthetic", "document_id": "syn_03037_8000", "document_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03037_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.0891520111440014, "origin_tokens": 5743, "compressed_tokens": 532, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5743, "source_tokens_receiver": 5743, "query_tokens": 632, "message_tokens": 532, "message_utf8_bytes": 2689, "cache_tensor_bytes": null, "serialized_payload_bytes": 2689, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 411.94866597652435, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.81220904830843, "ttft_ms": 13.756125001236796, "decode_ms": 13.445125077851117}, "total_wall_ms": 104.40166597254574, "ttft_ms": 13.756125001236796, "input_usage": {"receiver_prompt_tokens": 632}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840427008, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6876560948, "mlx_cache_bytes": 465650484, "process_rss_bytes": 9840427008}, "peak_prefill_memory": null, "peak_decode_memory": 6876560948, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03037_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "3698140997a489e46700f95229e9ab32664da34012cc5f10613cceeae5fa6954", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13467 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "2630c5da46fcbd44915e69b2", "attempt_id": "fc5a43532800", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:42:02.613422Z", "task_family": "synthetic", "document_id": "syn_03037_8000", "document_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03037_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.0891520111440014, "origin_tokens": 5743, "compressed_tokens": 532, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5743, "source_tokens_receiver": 5743, "query_tokens": 638, "message_tokens": 532, "message_utf8_bytes": 2689, "cache_tensor_bytes": null, "serialized_payload_bytes": 2689, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 411.94866597652435, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.2877919478342, "ttft_ms": 13.540165964514017, "decode_ms": 107.01845900621265}, "total_wall_ms": 198.12858302611858, "ttft_ms": 13.540165964514017, "input_usage": {"receiver_prompt_tokens": 638}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 9840443392, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6879936076, "mlx_cache_bytes": 845581608, "process_rss_bytes": 9840443392}, "peak_prefill_memory": null, "peak_decode_memory": 6879936076, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 964-S, Matagami", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03037_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.5714285714285715}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "3698140997a489e46700f95229e9ab32664da34012cc5f10613cceeae5fa6954", "output_hash": "ea538f4a0811a39f3982dfe26dc9b5b09602ca06af3c187835bf7413f4fdb605"} | |
| 13468 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "5ecae3a64c2d227f73eb0bdd", "attempt_id": "df1cf44a6130", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:42:02.838764Z", "task_family": "synthetic", "document_id": "syn_03037_8000", "document_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03037_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.0891520111440014, "origin_tokens": 5743, "compressed_tokens": 532, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5743, "source_tokens_receiver": 5743, "query_tokens": 636, "message_tokens": 532, "message_utf8_bytes": 2689, "cache_tensor_bytes": null, "serialized_payload_bytes": 2689, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 411.94866597652435, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.82120806910098, "ttft_ms": 13.526374939829111, "decode_ms": 13.37837497703731}, "total_wall_ms": 103.9563330123201, "ttft_ms": 13.526374939829111, "input_usage": {"receiver_prompt_tokens": 636}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840443392, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6879575628, "mlx_cache_bytes": 970427688, "process_rss_bytes": 9840443392}, "peak_prefill_memory": null, "peak_decode_memory": 6879575628, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03037_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "3698140997a489e46700f95229e9ab32664da34012cc5f10613cceeae5fa6954", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13469 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "d21af5f133d37158ff201f37", "attempt_id": "1023de9bb064", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:42:02.969535Z", "task_family": "synthetic", "document_id": "syn_03037_8000", "document_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03037_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.0891520111440014, "origin_tokens": 5743, "compressed_tokens": 532, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5743, "source_tokens_receiver": 5743, "query_tokens": 631, "message_tokens": 532, "message_utf8_bytes": 2689, "cache_tensor_bytes": null, "serialized_payload_bytes": 2689, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 411.94866597652435, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.84120898880064, "ttft_ms": 13.391542015597224, "decode_ms": 13.378084055148065}, "total_wall_ms": 102.83104190602899, "ttft_ms": 13.391542015597224, "input_usage": {"receiver_prompt_tokens": 631}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840443392, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6876560948, "mlx_cache_bytes": 970427688, "process_rss_bytes": 9840443392}, "peak_prefill_memory": null, "peak_decode_memory": 6876560948, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03037_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "3698140997a489e46700f95229e9ab32664da34012cc5f10613cceeae5fa6954", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13470 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "397142d513e85ca48f0c6bb4", "attempt_id": "3415c9c48020", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:42:03.099213Z", "task_family": "synthetic", "document_id": "syn_03037_8000", "document_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03037_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.0891520111440014, "origin_tokens": 5743, "compressed_tokens": 532, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5743, "source_tokens_receiver": 5743, "query_tokens": 644, "message_tokens": 532, "message_utf8_bytes": 2689, "cache_tensor_bytes": null, "serialized_payload_bytes": 2689, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 411.94866597652435, "decode_payload_ms": 0.0, "receiver_prefill_ms": 79.26074997521937, "ttft_ms": 13.608540990389884, "decode_ms": 13.29224999062717}, "total_wall_ms": 107.48920892365277, "ttft_ms": 13.608540990389884, "input_usage": {"receiver_prompt_tokens": 644}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840443392, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6884015716, "mlx_cache_bytes": 1354536756, "process_rss_bytes": 9840443392}, "peak_prefill_memory": null, "peak_decode_memory": 6884015716, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03037_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "3698140997a489e46700f95229e9ab32664da34012cc5f10613cceeae5fa6954", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13471 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "1b423cf9ab9d189ce96d4a7f", "attempt_id": "03d28b97cd80", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:42:04.002409Z", "task_family": "synthetic", "document_id": "syn_03038_16000", "document_hash": "5a11b0be7f9c210d91d212d00d966eecee65de0dd5d102b6647df2938b7c7326", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03038_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.047561542034370644, "origin_tokens": 10765, "compressed_tokens": 519, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10765, "source_tokens_receiver": 10765, "query_tokens": 616, "message_tokens": 519, "message_utf8_bytes": 2562, "cache_tensor_bytes": null, "serialized_payload_bytes": 2562, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 764.1654580365866, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.04791603423655, "ttft_ms": 13.745958916842937, "decode_ms": 13.571582967415452}, "total_wall_ms": 103.64579095039517, "ttft_ms": 13.745958916842937, "input_usage": {"receiver_prompt_tokens": 616}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840443392, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6867287540, "mlx_cache_bytes": 456114932, "process_rss_bytes": 9840443392}, "peak_prefill_memory": null, "peak_decode_memory": 6867287540, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03038_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "8e9195add14717369c9d97998420c3dae007ebd335b115ef5543d6341aa5bcff", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13472 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "91a0bda06506e136cdcb52b8", "attempt_id": "b04a4a7541fd", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:42:04.141757Z", "task_family": "synthetic", "document_id": "syn_03038_16000", "document_hash": "5a11b0be7f9c210d91d212d00d966eecee65de0dd5d102b6647df2938b7c7326", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03038_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.047561542034370644, "origin_tokens": 10765, "compressed_tokens": 519, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10765, "source_tokens_receiver": 10765, "query_tokens": 623, "message_tokens": 519, "message_utf8_bytes": 2562, "cache_tensor_bytes": null, "serialized_payload_bytes": 2562, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 764.1654580365866, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.98450006823987, "ttft_ms": 13.635457959026098, "decode_ms": 13.491249992512167}, "total_wall_ms": 103.35683298762888, "ttft_ms": 13.635457959026098, "input_usage": {"receiver_prompt_tokens": 623}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840459776, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6871547408, "mlx_cache_bytes": 827411628, "process_rss_bytes": 9840459776}, "peak_prefill_memory": null, "peak_decode_memory": 6871547408, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03038_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "8e9195add14717369c9d97998420c3dae007ebd335b115ef5543d6341aa5bcff", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13473 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "52ad536b5666b93b8ab1331a", "attempt_id": "e668d32781c2", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:42:04.280361Z", "task_family": "synthetic", "document_id": "syn_03038_16000", "document_hash": "5a11b0be7f9c210d91d212d00d966eecee65de0dd5d102b6647df2938b7c7326", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03038_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.047561542034370644, "origin_tokens": 10765, "compressed_tokens": 519, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10765, "source_tokens_receiver": 10765, "query_tokens": 622, "message_tokens": 519, "message_utf8_bytes": 2562, "cache_tensor_bytes": null, "serialized_payload_bytes": 2562, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 764.1654580365866, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.68529103789479, "ttft_ms": 13.589374953880906, "decode_ms": 13.361250050365925}, "total_wall_ms": 102.84908290486783, "ttft_ms": 13.589374953880906, "input_usage": {"receiver_prompt_tokens": 622}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840459776, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6902054416, "mlx_cache_bytes": 865586348, "process_rss_bytes": 9840459776}, "peak_prefill_memory": null, "peak_decode_memory": 6902054416, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03038_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "8e9195add14717369c9d97998420c3dae007ebd335b115ef5543d6341aa5bcff", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13474 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "d15df9d6b296e8e2ef20f641", "attempt_id": "84dd780e2a79", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:42:04.418104Z", "task_family": "synthetic", "document_id": "syn_03038_16000", "document_hash": "5a11b0be7f9c210d91d212d00d966eecee65de0dd5d102b6647df2938b7c7326", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03038_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.047561542034370644, "origin_tokens": 10765, "compressed_tokens": 519, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10765, "source_tokens_receiver": 10765, "query_tokens": 618, "message_tokens": 519, "message_utf8_bytes": 2562, "cache_tensor_bytes": null, "serialized_payload_bytes": 2562, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 764.1654580365866, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.4053750531748, "ttft_ms": 13.544499990530312, "decode_ms": 26.735167019069195}, "total_wall_ms": 115.86870905011892, "ttft_ms": 13.544499990530312, "input_usage": {"receiver_prompt_tokens": 618}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 9840459776, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6880411152, "mlx_cache_bytes": 1184484524, "process_rss_bytes": 9840459776}, "peak_prefill_memory": null, "peak_decode_memory": 6880411152, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Unknown.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03038_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "8e9195add14717369c9d97998420c3dae007ebd335b115ef5543d6341aa5bcff", "output_hash": "9cf9f50925b2a7803c73826a305235d4215dc428721c731072a9f2c0f5d6ae5a"} | |
| 13475 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "21355648fbaadf6f96a8d2fc", "attempt_id": "0e1e2e5aea41", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:42:04.568867Z", "task_family": "synthetic", "document_id": "syn_03038_16000", "document_hash": "5a11b0be7f9c210d91d212d00d966eecee65de0dd5d102b6647df2938b7c7326", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03038_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.047561542034370644, "origin_tokens": 10765, "compressed_tokens": 519, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10765, "source_tokens_receiver": 10765, "query_tokens": 625, "message_tokens": 519, "message_utf8_bytes": 2562, "cache_tensor_bytes": null, "serialized_payload_bytes": 2562, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 764.1654580365866, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.65016702190042, "ttft_ms": 13.610624941065907, "decode_ms": 13.432667008601129}, "total_wall_ms": 102.92975010816008, "ttft_ms": 13.610624941065907, "input_usage": {"receiver_prompt_tokens": 625}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840459776, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6872104472, "mlx_cache_bytes": 1368512108, "process_rss_bytes": 9840459776}, "peak_prefill_memory": null, "peak_decode_memory": 6872104472, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03038_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "8e9195add14717369c9d97998420c3dae007ebd335b115ef5543d6341aa5bcff", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13476 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "04da7f30d5110f8a2aca1d06", "attempt_id": "cfb8655c4280", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:42:04.843024Z", "task_family": "synthetic", "document_id": "syn_03039_2000", "document_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03039_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2942528735632184, "origin_tokens": 1740, "compressed_tokens": 628, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1740, "source_tokens_receiver": 1740, "query_tokens": 726, "message_tokens": 628, "message_utf8_bytes": 2316, "cache_tensor_bytes": null, "serialized_payload_bytes": 2316, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 133.05070903152227, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.89770800527185, "ttft_ms": 13.673500041477382, "decode_ms": 13.64233298227191}, "total_wall_ms": 110.50095909740776, "ttft_ms": 13.673500041477382, "input_usage": {"receiver_prompt_tokens": 726}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840443392, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6930939820, "mlx_cache_bytes": 521569452, "process_rss_bytes": 9840443392}, "peak_prefill_memory": null, "peak_decode_memory": 6930939820, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03039_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "7c353421857746c7497f12f5df703a5d3fcbdb4ea549bc94420b0c4b4509ebc2", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 13477 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "7ac3e7fc7710e41082245dd0", "attempt_id": "0eed294fda42", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:42:04.976219Z", "task_family": "synthetic", "document_id": "syn_03039_2000", "document_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03039_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2942528735632184, "origin_tokens": 1740, "compressed_tokens": 628, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1740, "source_tokens_receiver": 1740, "query_tokens": 732, "message_tokens": 628, "message_utf8_bytes": 2316, "cache_tensor_bytes": null, "serialized_payload_bytes": 2316, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 133.05070903152227, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.9255419773981, "ttft_ms": 13.768458971753716, "decode_ms": 148.1083749094978}, "total_wall_ms": 245.09454204235226, "ttft_ms": 13.768458971753716, "input_usage": {"receiver_prompt_tokens": 732}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 9840459776, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6935019460, "mlx_cache_bytes": 958124056, "process_rss_bytes": 9840459776}, "peak_prefill_memory": null, "peak_decode_memory": 6935019460, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 191-F, Baie-Comeau.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03039_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "7c353421857746c7497f12f5df703a5d3fcbdb4ea549bc94420b0c4b4509ebc2", "output_hash": "ef70e3faf7fbd0db92047de71c18d558816c8be121e161b7e5bfd81f0ccdb220"} | |
| 13478 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "c3fbf1b274a8031b42d4bd73", "attempt_id": "7369aac539be", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:42:05.243158Z", "task_family": "synthetic", "document_id": "syn_03039_2000", "document_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03039_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2942528735632184, "origin_tokens": 1740, "compressed_tokens": 628, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1740, "source_tokens_receiver": 1740, "query_tokens": 731, "message_tokens": 628, "message_utf8_bytes": 2316, "cache_tensor_bytes": null, "serialized_payload_bytes": 2316, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 133.05070903152227, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.47354202810675, "ttft_ms": 13.51058401633054, "decode_ms": 67.16599990613759}, "total_wall_ms": 163.39929099194705, "ttft_ms": 13.51058401633054, "input_usage": {"receiver_prompt_tokens": 731}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 9840459776, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6910984120, "mlx_cache_bytes": 971591704, "process_rss_bytes": 9840459776}, "peak_prefill_memory": null, "peak_decode_memory": 6910984120, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "40. 2091", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03039_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "7c353421857746c7497f12f5df703a5d3fcbdb4ea549bc94420b0c4b4509ebc2", "output_hash": "f80d9ffb08311dbf3eb21bccb234522246266a13d7522fd03ee41f40c7c4d317"} | |
| 13479 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "c246051512cf63373b65bf7d", "attempt_id": "4f5d40111c55", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:42:05.428912Z", "task_family": "synthetic", "document_id": "syn_03039_2000", "document_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03039_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2942528735632184, "origin_tokens": 1740, "compressed_tokens": 628, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1740, "source_tokens_receiver": 1740, "query_tokens": 727, "message_tokens": 628, "message_utf8_bytes": 2316, "cache_tensor_bytes": null, "serialized_payload_bytes": 2316, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 133.05070903152227, "decode_payload_ms": 0.0, "receiver_prefill_ms": 80.97483299206942, "ttft_ms": 13.56324995867908, "decode_ms": 107.06000006757677}, "total_wall_ms": 202.90654199197888, "ttft_ms": 13.56324995867908, "input_usage": {"receiver_prompt_tokens": 727}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 9840459776, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6931857348, "mlx_cache_bytes": 1297715224, "process_rss_bytes": 9840459776}, "peak_prefill_memory": null, "peak_decode_memory": 6931857348, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Novnovnov-16, unknown.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03039_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "7c353421857746c7497f12f5df703a5d3fcbdb4ea549bc94420b0c4b4509ebc2", "output_hash": "6c7015ec472a4d7b54bff9eaf7faf2e93a52140df508aba3be0126bd21ccbf4a"} | |
| 13480 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "2279a9a1f171d75ea4adf795", "attempt_id": "84da33b51997", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:42:05.653561Z", "task_family": "synthetic", "document_id": "syn_03039_2000", "document_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03039_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2942528735632184, "origin_tokens": 1740, "compressed_tokens": 628, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1740, "source_tokens_receiver": 1740, "query_tokens": 734, "message_tokens": 628, "message_utf8_bytes": 2316, "cache_tensor_bytes": null, "serialized_payload_bytes": 2316, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 133.05070903152227, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.45424991380423, "ttft_ms": 13.736290973611176, "decode_ms": 40.23583303205669}, "total_wall_ms": 136.69674994889647, "ttft_ms": 13.736290973611176, "input_usage": {"receiver_prompt_tokens": 734}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 9840459776, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6935576524, "mlx_cache_bytes": 1513986956, "process_rss_bytes": 9840459776}, "peak_prefill_memory": null, "peak_decode_memory": 6935576524, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "27,162", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03039_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "7c353421857746c7497f12f5df703a5d3fcbdb4ea549bc94420b0c4b4509ebc2", "output_hash": "ec1573760b33b4eb60e220b079dacf19ecc3d62bca9b0e512755dc719b322975"} | |
| 13481 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "4c9c1ad4441c175fc02a0d85", "attempt_id": "610a4c293f7d", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:42:05.968289Z", "task_family": "exec", "document_id": "exec_00201_2000", "document_hash": "065b6c18bbd16f16126924a54946ca4bf95c5863e57b14f33e4c9d88568f8549", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00201_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2905788876276958, "origin_tokens": 1762, "compressed_tokens": 566, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1762, "source_tokens_receiver": 1762, "query_tokens": 672, "message_tokens": 566, "message_utf8_bytes": 2515, "cache_tensor_bytes": null, "serialized_payload_bytes": 2515, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 151.8884999677539, "decode_payload_ms": 0.0, "receiver_prefill_ms": 79.9616250442341, "ttft_ms": 13.48108402453363, "decode_ms": 1478.1810420099646}, "total_wall_ms": 1572.9792080819607, "ttft_ms": 13.48108402453363, "input_usage": {"receiver_prompt_tokens": 672}, "output_usage": {"output_tokens": 110}, "provider_cached_usage": null, "process_memory": 9840541696, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6899744468, "mlx_cache_bytes": 614269908, "process_rss_bytes": 9840541696}, "peak_prefill_memory": null, "peak_decode_memory": 6899744468, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n net_revenue = 0\n for row in rows:\n if row[5]:\n if row[0] < 4:\n total_price = row[1] * (1 - row[2] / 100)\n net_revenue += total_price\n else:\n net_revenue += row[1]\n else:\n net_revenue += row[1] * (1 - row[2] / 100)\n return net_revenue\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00201_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "b2e1317c1951d683259b9938cbabc418e9c3046c6cd096768309656e6b4c6707", "output_hash": "62a6e672d1ce8c036eff5d2c6ec4249979c8945bf8b0c06faf5933e431a92bfd"} | |
| 13482 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "d6462df67d245a103683f8e0", "attempt_id": "c89abd5d5085", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:42:07.765260Z", "task_family": "exec", "document_id": "exec_00202_2000", "document_hash": "ec13194237af7efe7765a21f1d8303ab8ac449271eb48e3395906648c770bab8", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00202_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2925714285714286, "origin_tokens": 1750, "compressed_tokens": 580, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1750, "source_tokens_receiver": 1750, "query_tokens": 687, "message_tokens": 580, "message_utf8_bytes": 2422, "cache_tensor_bytes": null, "serialized_payload_bytes": 2422, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 172.19750001095235, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.14566595759243, "ttft_ms": 13.436250039376318, "decode_ms": 1604.1294580791146}, "total_wall_ms": 1700.0405000289902, "ttft_ms": 13.436250039376318, "input_usage": {"receiver_prompt_tokens": 687}, "output_usage": {"output_tokens": 119}, "provider_cached_usage": null, "process_memory": 9840558080, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6908641040, "mlx_cache_bytes": 623412240, "process_rss_bytes": 9840558080}, "peak_prefill_memory": null, "peak_decode_memory": 6908641040, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n total_price = 0\n return_dict = {}\n for row in rows:\n if row[3]:\n unit_price = row[2] * row[4]\n discount = row[2] * row[5]\n total_price += unit_price - discount\n return_dict[row[0]] = {\n 'total_price': unit_price - discount,\n 'return': round((unit_price - discount - row[6]) / unit_price * 100)\n }\n return total_price, return_dict\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00202_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "958baf63c26ecfa6416dda54aa3ad7996f19e75c27e510ebb03fd914e69b1667", "output_hash": "9c473ae01c753b0555e42f736b12b8b13772e7cb55fbd84879a274f50317fcc4"} | |
| 13483 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "fb6eae1b8228cb6c3a66c2d1", "attempt_id": "1a409805d1c7", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:42:09.689477Z", "task_family": "exec", "document_id": "exec_00203_2000", "document_hash": "39eee37c7ba5fe1b6d8fce9eef4c00e10a33d8ca049d12ae01b9521d4ac60863", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00203_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.29157175398633256, "origin_tokens": 1756, "compressed_tokens": 579, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1756, "source_tokens_receiver": 1756, "query_tokens": 685, "message_tokens": 579, "message_utf8_bytes": 2433, "cache_tensor_bytes": null, "serialized_payload_bytes": 2433, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 171.28337500616908, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.12733298912644, "ttft_ms": 13.676374917849898, "decode_ms": 959.1150420019403}, "total_wall_ms": 1055.442874901928, "ttft_ms": 13.676374917849898, "input_usage": {"receiver_prompt_tokens": 685}, "output_usage": {"output_tokens": 71}, "provider_cached_usage": null, "process_memory": 9840558080, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6907379464, "mlx_cache_bytes": 497337352, "process_rss_bytes": 9840558080}, "peak_prefill_memory": null, "peak_decode_memory": 6907379464, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n total_price = 0\n for row in rows:\n if row[3] < 5:\n continue\n unit_price = row[1] - (row[1] * row[2] / 100)\n total_price += unit_price\n return total_price\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00203_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "b03918646d03efbe8088b0c87a0f6308fc2c637b6c68067e28ca13e1bf5b0973", "output_hash": "9c4f7528d4bad7234c8ac0e0afb2dbca5375c4105e1e511f00817bcd25097236"} | |
| 13484 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "249692f5ce8f1d73a6740de8", "attempt_id": "fb51489c21df", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:42:10.966933Z", "task_family": "exec", "document_id": "exec_00204_2000", "document_hash": "0aaf1a095160aa21c4485db3b1b171e86d9d41b904ac2a2ea102cc13df19cd22", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00204_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2882882882882883, "origin_tokens": 1776, "compressed_tokens": 571, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1776, "source_tokens_receiver": 1776, "query_tokens": 677, "message_tokens": 571, "message_utf8_bytes": 2437, "cache_tensor_bytes": null, "serialized_payload_bytes": 2437, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 172.06537502352148, "decode_payload_ms": 0.0, "receiver_prefill_ms": 80.74979193042964, "ttft_ms": 13.673665933310986, "decode_ms": 1547.018332988955}, "total_wall_ms": 1642.768583027646, "ttft_ms": 13.673665933310986, "input_usage": {"receiver_prompt_tokens": 677}, "output_usage": {"output_tokens": 115}, "provider_cached_usage": null, "process_memory": 9840558080, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6902742760, "mlx_cache_bytes": 617350120, "process_rss_bytes": 9840558080}, "peak_prefill_memory": null, "peak_decode_memory": 6902742760, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n net_revenue = []\n for row in rows:\n total_price = row[1] * row[2]\n discount = total_price * row[3] / 100\n total_price -= discount\n tax = total_price * row[4] / 100\n total_price -= tax\n if row[5]:\n total_price -= total_price * row[6] / 100\n net_revenue.append([row[0], total_price])\n return net_revenue\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00204_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "b7473c9b2ca34ae2ad15a2f4942179c42282d616b583ea59fc5a9c9279c50de4", "output_hash": "3a25256cab462a5e1cb32c2c1077112ba4d284b7186c251430927e593e89675f"} | |
| 13485 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "fcffc2920a4be15dd5396dac", "attempt_id": "09276543f2ae", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:42:12.835175Z", "task_family": "exec", "document_id": "exec_00205_2000", "document_hash": "c82f149ddbd77be80773d103825621fb187f06bb60d4fd570c73c2b3cd898ecb", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00205_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2879640044994376, "origin_tokens": 1778, "compressed_tokens": 578, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1778, "source_tokens_receiver": 1778, "query_tokens": 684, "message_tokens": 578, "message_utf8_bytes": 2327, "cache_tensor_bytes": null, "serialized_payload_bytes": 2327, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 171.99858301319182, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.34491695091128, "ttft_ms": 13.695165980607271, "decode_ms": 2792.174707981758}, "total_wall_ms": 2888.588665984571, "ttft_ms": 13.695165980607271, "input_usage": {"receiver_prompt_tokens": 684}, "output_usage": {"output_tokens": 203}, "provider_cached_usage": null, "process_memory": 9840607232, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6907199236, "mlx_cache_bytes": 621921284, "process_rss_bytes": 9840607232}, "peak_prefill_memory": null, "peak_decode_memory": 6907199236, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n net_revenue = []\n for row in rows:\n if row[3]:\n if row[2] < 2:\n net_revenue.append({\n 'revenue': row[0],\n 'unit_price': row[1],\n 'days': row[2],\n 'return': row[3],\n 'result': row[4]\n })\n else:\n discount = row[1] * row[4] / 100\n unit_price = row[1] - discount\n tax = unit_price * row[2] * row[4] / 100\n net_revenue.append({\n 'revenue': row[0] * row[4],\n 'unit_price': unit_price,\n 'days': row[2],\n 'return': row[3],\n 'result': row[4],\n 'tax': tax\n })\n return net_revenue\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00205_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "423a49a4accbb29d70f7498f3ebf493e0c0481ec1422a6875554275ac1745e8a", "output_hash": "a307b446a77dfaebc3d534f4333abf69203f14ae8a6eabb7ccb4cb5570ca3b0e"} | |
| 13486 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "8ba5551920d488af0ada35b4", "attempt_id": "a9fa9ad4ba9f", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:42:15.948869Z", "task_family": "exec", "document_id": "exec_00206_2000", "document_hash": "e391c9d757bc03677c664222c3ff3f1bbab881d7f566c0072b184e0b90503339", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00206_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2925714285714286, "origin_tokens": 1750, "compressed_tokens": 584, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1750, "source_tokens_receiver": 1750, "query_tokens": 690, "message_tokens": 584, "message_utf8_bytes": 2394, "cache_tensor_bytes": null, "serialized_payload_bytes": 2394, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 171.46862507797778, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.24412503093481, "ttft_ms": 13.564125052653253, "decode_ms": 1656.4636249095201}, "total_wall_ms": 1752.6230829535052, "ttft_ms": 13.564125052653253, "input_usage": {"receiver_prompt_tokens": 690}, "output_usage": {"output_tokens": 123}, "provider_cached_usage": null, "process_memory": 9840607232, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6910574364, "mlx_cache_bytes": 625394716, "process_rss_bytes": 9840607232}, "peak_prefill_memory": null, "peak_decode_memory": 6910574364, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n net_revenue = 0\n for row in rows:\n if row[3] < 4:\n continue\n if row[3] < 4 and row[4] < 0:\n continue\n if row[4] < 0:\n net_revenue += row[2] * (1 - row[4])\n else:\n net_revenue += row[2] * (1 - row[4]) * (1 + row[4] / 100)\n return net_revenue\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00206_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "91535a844a7c8262e6f7eb2869f5f0ce078ee999e468a110e4336dff99f138d3", "output_hash": "1cd5a1a531494e01135bfff7b53b5e0ed8bcf8a7082638991c6dc75c3514efd9"} | |
modified
runs/raw/E4_core.jsonl
+975 −0
@@ -6223,3 +6223,978 @@ | ||
| 6223 | 6223 | {"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b162f886218841a39399343c", "attempt_id": "e4e63600f593", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:17:30.169852Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 468, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21718.831210047938, "hops": {"1": 6925.180334015749, "2": 4936.230916995555, "3": 4929.1688749799505, "4": 4928.251084056683}, "receiver_prefill_ms": 185.62729097902775, "ttft_ms": 11.925874976441264, "decode_ms": 47.405832912772894}, "total_wall_ms": 21964.225627016276, "ttft_ms": 11.925874976441264, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "22.3", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "8afb0bb35e730fd32e7805d65081241bd21f43709df37165f4ec91c763f8a99d"} |
| 6224 | 6224 | {"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "cb082e8097f0ee67f129a690", "attempt_id": "754476efbb71", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:17:30.429713Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 473, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21718.831210047938, "hops": {"1": 6925.180334015749, "2": 4936.230916995555, "3": 4929.1688749799505, "4": 4928.251084056683}, "receiver_prefill_ms": 186.26170803327113, "ttft_ms": 11.866291984915733, "decode_ms": 11.894959025084972}, "total_wall_ms": 21929.25254406873, "ttft_ms": 11.866291984915733, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} |
| 6225 | 6225 | {"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "89e13de313a27070f96961f5", "attempt_id": "1192f28acd67", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:17:30.655083Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 475, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21718.831210047938, "hops": {"1": 6925.180334015749, "2": 4936.230916995555, "3": 4929.1688749799505, "4": 4928.251084056683}, "receiver_prefill_ms": 185.66583399660885, "ttft_ms": 11.722749914042652, "decode_ms": 11.803374974988401}, "total_wall_ms": 21928.473793086596, "ttft_ms": 11.722749914042652, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} |
| 6226 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "1f7aa4ac28db426e9462c704", "attempt_id": "509f0586ceb4", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:17:50.591976Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 460, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 41427.24412702955, "hops": {"1": 6925.180334015749, "2": 4936.230916995555, "3": 4929.1688749799505, "4": 4928.251084056683, "5": 4930.099040968344, "6": 4925.894750049338, "7": 4927.353916922584, "8": 4925.06520904135}, "receiver_prefill_ms": 185.69120892789215, "ttft_ms": 11.868500034324825, "decode_ms": 11.89162500668317}, "total_wall_ms": 41637.12862704415, "ttft_ms": 11.868500034324825, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6227 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "30827b67cd75275a944ecfa3", "attempt_id": "4b956dd8efe7", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:17:50.817498Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 466, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 41427.24412702955, "hops": {"1": 6925.180334015749, "2": 4936.230916995555, "3": 4929.1688749799505, "4": 4928.251084056683, "5": 4930.099040968344, "6": 4925.894750049338, "7": 4927.353916922584, "8": 4925.06520904135}, "receiver_prefill_ms": 185.96262496430427, "ttft_ms": 11.96454104501754, "decode_ms": 11.789167067036033}, "total_wall_ms": 41637.3655020725, "ttft_ms": 11.96454104501754, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6228 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "bcf0fac8f19bd29a06f64021", "attempt_id": "9dabebf42c6a", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:17:51.042525Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 466, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 41427.24412702955, "hops": {"1": 6925.180334015749, "2": 4936.230916995555, "3": 4929.1688749799505, "4": 4928.251084056683, "5": 4930.099040968344, "6": 4925.894750049338, "7": 4927.353916922584, "8": 4925.06520904135}, "receiver_prefill_ms": 184.82099997345358, "ttft_ms": 11.880457983352244, "decode_ms": 12.16229097917676}, "total_wall_ms": 41636.48425193969, "ttft_ms": 11.880457983352244, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6229 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "cd80899899222e560f14c4e9", "attempt_id": "78a54017cc1b", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:17:51.266420Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 463, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 41427.24412702955, "hops": {"1": 6925.180334015749, "2": 4936.230916995555, "3": 4929.1688749799505, "4": 4928.251084056683, "5": 4930.099040968344, "6": 4925.894750049338, "7": 4927.353916922584, "8": 4925.06520904135}, "receiver_prefill_ms": 185.6077500851825, "ttft_ms": 11.889124987646937, "decode_ms": 11.934250011108816}, "total_wall_ms": 41637.05754408147, "ttft_ms": 11.889124987646937, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6230 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "83ec9388a20a29c81d9609ee", "attempt_id": "332b65d6084c", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:17:51.491055Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 470, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 41427.24412702955, "hops": {"1": 6925.180334015749, "2": 4936.230916995555, "3": 4929.1688749799505, "4": 4928.251084056683, "5": 4930.099040968344, "6": 4925.894750049338, "7": 4927.353916922584, "8": 4925.06520904135}, "receiver_prefill_ms": 185.66837499383837, "ttft_ms": 11.86079194303602, "decode_ms": 11.88775000628084}, "total_wall_ms": 41637.0368769858, "ttft_ms": 11.86079194303602, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6231 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "30ffe3b485f5c222e3deccb5", "attempt_id": "d32427a19537", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:17:51.715250Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 471, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 41427.24412702955, "hops": {"1": 6925.180334015749, "2": 4936.230916995555, "3": 4929.1688749799505, "4": 4928.251084056683, "5": 4930.099040968344, "6": 4925.894750049338, "7": 4927.353916922584, "8": 4925.06520904135}, "receiver_prefill_ms": 186.16775004193187, "ttft_ms": 11.90533407498151, "decode_ms": 11.867707944475114}, "total_wall_ms": 41637.58175203111, "ttft_ms": 11.90533407498151, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6232 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "2f0b7943918e7a32b5613d88", "attempt_id": "5bcda0480d37", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:17:51.940219Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 461, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 41427.24412702955, "hops": {"1": 6925.180334015749, "2": 4936.230916995555, "3": 4929.1688749799505, "4": 4928.251084056683, "5": 4930.099040968344, "6": 4925.894750049338, "7": 4927.353916922584, "8": 4925.06520904135}, "receiver_prefill_ms": 184.79249998927116, "ttft_ms": 11.864167056046426, "decode_ms": 11.8454999756068}, "total_wall_ms": 41636.138335918076, "ttft_ms": 11.864167056046426, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | |
| 6233 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "05ffc38086f0787c6e85c95a", "attempt_id": "486fe2b6e0e0", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:17:52.163716Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 462, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 41427.24412702955, "hops": {"1": 6925.180334015749, "2": 4936.230916995555, "3": 4929.1688749799505, "4": 4928.251084056683, "5": 4930.099040968344, "6": 4925.894750049338, "7": 4927.353916922584, "8": 4925.06520904135}, "receiver_prefill_ms": 185.69795798975974, "ttft_ms": 11.89908292144537, "decode_ms": 11.869458016008139}, "total_wall_ms": 41637.0997519698, "ttft_ms": 11.89908292144537, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | |
| 6234 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5b795e637a0776a0efff044b", "attempt_id": "4d2df655a5d0", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:17:52.387894Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 478, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 41427.24412702955, "hops": {"1": 6925.180334015749, "2": 4936.230916995555, "3": 4929.1688749799505, "4": 4928.251084056683, "5": 4930.099040968344, "6": 4925.894750049338, "7": 4927.353916922584, "8": 4925.06520904135}, "receiver_prefill_ms": 186.6634590551257, "ttft_ms": 11.852583033032715, "decode_ms": 11.909167049452662}, "total_wall_ms": 41638.05362698622, "ttft_ms": 11.852583033032715, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6235 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5ea45deb13726ba60308bfec", "attempt_id": "5623b1124162", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:17:52.612954Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 469, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 41427.24412702955, "hops": {"1": 6925.180334015749, "2": 4936.230916995555, "3": 4929.1688749799505, "4": 4928.251084056683, "5": 4930.099040968344, "6": 4925.894750049338, "7": 4927.353916922584, "8": 4925.06520904135}, "receiver_prefill_ms": 185.8509590383619, "ttft_ms": 11.948750005103648, "decode_ms": 11.846582987345755}, "total_wall_ms": 41637.2786690481, "ttft_ms": 11.948750005103648, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6236 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c7b937c223f4ac6fb25e9cf4", "attempt_id": "16b457b0913a", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:17:52.837790Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 477, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 41427.24412702955, "hops": {"1": 6925.180334015749, "2": 4936.230916995555, "3": 4929.1688749799505, "4": 4928.251084056683, "5": 4930.099040968344, "6": 4925.894750049338, "7": 4927.353916922584, "8": 4925.06520904135}, "receiver_prefill_ms": 186.66258396115154, "ttft_ms": 11.848125024698675, "decode_ms": 59.24800003413111}, "total_wall_ms": 41685.39125204552, "ttft_ms": 11.848125024698675, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Kovar-9", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "c969b5f7547945067f5b07e9f822d0043126326f979d950a8b1b045057fbb818"} | |
| 6237 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "172399ef80b88f0477f16468", "attempt_id": "0e7ab39679a1", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:17:53.110680Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 473, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 41427.24412702955, "hops": {"1": 6925.180334015749, "2": 4936.230916995555, "3": 4929.1688749799505, "4": 4928.251084056683, "5": 4930.099040968344, "6": 4925.894750049338, "7": 4927.353916922584, "8": 4925.06520904135}, "receiver_prefill_ms": 185.79341599252075, "ttft_ms": 11.93629193585366, "decode_ms": 71.10645901411772}, "total_wall_ms": 41696.49600202683, "ttft_ms": 11.93629193585366, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "972465", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "0a00e59631ae965bf9ab3d3d1f18cb59d92aea878baa86f032ccec5b0696dce0"} | |
| 6238 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c0cde1360a80dd776b398901", "attempt_id": "35867cd3df7c", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:17:53.394481Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 468, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 41427.24412702955, "hops": {"1": 6925.180334015749, "2": 4936.230916995555, "3": 4929.1688749799505, "4": 4928.251084056683, "5": 4930.099040968344, "6": 4925.894750049338, "7": 4927.353916922584, "8": 4925.06520904135}, "receiver_prefill_ms": 185.3639589389786, "ttft_ms": 12.168999994173646, "decode_ms": 47.6904169190675}, "total_wall_ms": 41673.04825200699, "ttft_ms": 12.168999994173646, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "22.3", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "8afb0bb35e730fd32e7805d65081241bd21f43709df37165f4ec91c763f8a99d"} | |
| 6239 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c4b0e4f592543159cb5475f6", "attempt_id": "6c18494121ad", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:17:53.655585Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 473, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 41427.24412702955, "hops": {"1": 6925.180334015749, "2": 4936.230916995555, "3": 4929.1688749799505, "4": 4928.251084056683, "5": 4930.099040968344, "6": 4925.894750049338, "7": 4927.353916922584, "8": 4925.06520904135}, "receiver_prefill_ms": 186.04341603349894, "ttft_ms": 12.104833964258432, "decode_ms": 12.137249927036464}, "total_wall_ms": 41638.14587704837, "ttft_ms": 12.104833964258432, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6240 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "185678dd0114cdb5fae5b0a9", "attempt_id": "267d568814ca", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:17:53.883722Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 475, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 41427.24412702955, "hops": {"1": 6925.180334015749, "2": 4936.230916995555, "3": 4929.1688749799505, "4": 4928.251084056683, "5": 4930.099040968344, "6": 4925.894750049338, "7": 4927.353916922584, "8": 4925.06520904135}, "receiver_prefill_ms": 186.3162920344621, "ttft_ms": 12.045166920870543, "decode_ms": 12.15504202991724}, "total_wall_ms": 41638.27246008441, "ttft_ms": 12.045166920870543, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6241 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "af0e42d0b1084fed64200fde", "attempt_id": "989677fd86d5", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:00.972787Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 592, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6860.111457994208, "hops": {"1": 6860.111457994208}, "receiver_prefill_ms": 226.402125088498, "ttft_ms": 12.21316703595221, "decode_ms": 11.887833010405302}, "total_wall_ms": 7111.151498975232, "ttft_ms": 12.21316703595221, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6242 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b2a09d16aff35ab7f9f40b15", "attempt_id": "db58afecd8ae", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:01.239208Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 598, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6860.111457994208, "hops": {"1": 6860.111457994208}, "receiver_prefill_ms": 226.97008401155472, "ttft_ms": 12.136540957726538, "decode_ms": 130.98520797211677}, "total_wall_ms": 7230.709374998696, "ttft_ms": 12.136540957726538, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 536-R, Senneterre", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "5e85af24aac0f1904d70a2fcee84f1b6f6912cc7450298af1f173002fd8e59df"} | |
| 6243 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "da421a27d683d923570a3bc2", "attempt_id": "14e935e8b50a", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:01.624983Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 598, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6860.111457994208, "hops": {"1": 6860.111457994208}, "receiver_prefill_ms": 227.0039999857545, "ttft_ms": 11.921084020286798, "decode_ms": 83.41558300890028}, "total_wall_ms": 7183.151665958576, "ttft_ms": 11.921084020286798, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "88.7751", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "1e01e62c69f9479b681e50e59e8565c6583f5cdb803446a05ed5cb13118acdf9"} | |
| 6244 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "87baee15405fb7a62bff50d2", "attempt_id": "7d40e380956a", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:01.962819Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6860.111457994208, "hops": {"1": 6860.111457994208}, "receiver_prefill_ms": 226.7918330617249, "ttft_ms": 12.025915901176631, "decode_ms": 47.71212500054389}, "total_wall_ms": 7147.156000020914, "ttft_ms": 12.025915901176631, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Ingrid Mbeki", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "1dbd85090bb65fb3b72de8ca4ce32f2c234729ff4a239274e79fb574b800a79d"} | |
| 6245 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e23c03ec72a3a634e13ecf7e", "attempt_id": "f97a4fc05b84", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:02.265293Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 602, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6860.111457994208, "hops": {"1": 6860.111457994208}, "receiver_prefill_ms": 227.13754198048264, "ttft_ms": 12.27516692597419, "decode_ms": 12.184666004031897}, "total_wall_ms": 7112.408332992345, "ttft_ms": 12.27516692597419, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6246 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a55f5f9c37ddc26b42971966", "attempt_id": "44e010c85d45", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:02.533199Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6860.111457994208, "hops": {"1": 6860.111457994208}, "receiver_prefill_ms": 227.2484590066597, "ttft_ms": 12.140959035605192, "decode_ms": 131.11216691322625}, "total_wall_ms": 7231.239791959524, "ttft_ms": 12.140959035605192, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "BQ-59Z-6753", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "db250f072c856fe7ddf4bbbd16e20c71b8bad1eef5e4480acd0dac30f8ffe9cd"} | |
| 6247 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e0f9e0331ae77f1f3c4dcca6", "attempt_id": "16627c9a08a4", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:02.921271Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 593, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6860.111457994208, "hops": {"1": 6860.111457994208}, "receiver_prefill_ms": 226.95445804856718, "ttft_ms": 11.989000020548701, "decode_ms": 11.9677500333637}, "total_wall_ms": 7111.529208021238, "ttft_ms": 11.989000020548701, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | |
| 6248 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "eaf351a567901b5d636b7901", "attempt_id": "7c7a9334f070", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:03.188021Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 594, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6860.111457994208, "hops": {"1": 6860.111457994208}, "receiver_prefill_ms": 226.48525005206466, "ttft_ms": 12.032832950353622, "decode_ms": 11.912500020116568}, "total_wall_ms": 7111.016624025069, "ttft_ms": 12.032832950353622, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "yes", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "8a798890fe93817163b10b5f7bd2ca4d25d84c52739a645a889c173eee7d9d3d"} | |
| 6249 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "451cfecc9918407050534893", "attempt_id": "74f1140d4484", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:03.453727Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 610, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6860.111457994208, "hops": {"1": 6860.111457994208}, "receiver_prefill_ms": 229.28704204969108, "ttft_ms": 12.16325000859797, "decode_ms": 12.026750016957521}, "total_wall_ms": 7114.078290993348, "ttft_ms": 12.16325000859797, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6250 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "378adc8a667fa8fddede73d1", "attempt_id": "45697d980867", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:03.722608Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 601, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6860.111457994208, "hops": {"1": 6860.111457994208}, "receiver_prefill_ms": 226.62954207044095, "ttft_ms": 11.946208076551557, "decode_ms": 12.06508302129805}, "total_wall_ms": 7111.226874985732, "ttft_ms": 11.946208076551557, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6251 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "bd5b8288eb43fbc74778ca88", "attempt_id": "fe63c1a2ee72", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:03.988549Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 609, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6860.111457994208, "hops": {"1": 6860.111457994208}, "receiver_prefill_ms": 227.37750003580004, "ttft_ms": 11.970457970164716, "decode_ms": 59.540791902691126}, "total_wall_ms": 7159.483207971789, "ttft_ms": 11.970457970164716, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Kovar-9", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "c969b5f7547945067f5b07e9f822d0043126326f979d950a8b1b045057fbb818"} | |
| 6252 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "693d6ee093db0ab9f80e4ef8", "attempt_id": "3467a640ac8a", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:04.302529Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 605, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6860.111457994208, "hops": {"1": 6860.111457994208}, "receiver_prefill_ms": 227.26708301343024, "ttft_ms": 11.9785419665277, "decode_ms": 83.4002080373466}, "total_wall_ms": 7183.243583072908, "ttft_ms": 11.9785419665277, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1302481", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "1c130ebf03e5051f031da47a49e8c91caae34e3c2144f451ec045a8e1c85549d"} | |
| 6253 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f1dec0bdc802d2531d269fdc", "attempt_id": "b6562f2ad885", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:04.640930Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6860.111457994208, "hops": {"1": 6860.111457994208}, "receiver_prefill_ms": 226.34291695430875, "ttft_ms": 12.062499998137355, "decode_ms": 11.937125003896654}, "total_wall_ms": 7111.109748948365, "ttft_ms": 12.062499998137355, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6254 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "225aa0bdffe8ab7c68a1bc2d", "attempt_id": "1284cd7b8c1e", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:04.906734Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 605, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6860.111457994208, "hops": {"1": 6860.111457994208}, "receiver_prefill_ms": 226.39533400069922, "ttft_ms": 12.255124980583787, "decode_ms": 11.995458044111729}, "total_wall_ms": 7111.378874978982, "ttft_ms": 12.255124980583787, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6255 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c4f55ba6563dde2e253a68fa", "attempt_id": "74385a148ddf", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:05.172487Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 607, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6860.111457994208, "hops": {"1": 6860.111457994208}, "receiver_prefill_ms": 226.69262497220188, "ttft_ms": 12.230082997120917, "decode_ms": 12.032125028781593}, "total_wall_ms": 7111.5701659582555, "ttft_ms": 12.230082997120917, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6256 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d62a89297f31d2f14e52f08a", "attempt_id": "ec06dd215e7b", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:11.742463Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 577, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13161.659458070062, "hops": {"1": 6860.111457994208, "2": 6301.548000075854}, "receiver_prefill_ms": 209.32583301328123, "ttft_ms": 11.933750007301569, "decode_ms": 11.934750014916062}, "total_wall_ms": 13395.379541092552, "ttft_ms": 11.933750007301569, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6257 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7d7b6fdd2cccadcb17bc0a68", "attempt_id": "b476270061c4", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:11.991795Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 583, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13161.659458070062, "hops": {"1": 6860.111457994208, "2": 6301.548000075854}, "receiver_prefill_ms": 227.2348329424858, "ttft_ms": 11.93300005979836, "decode_ms": 130.301000084728}, "total_wall_ms": 13531.631125020795, "ttft_ms": 11.93300005979836, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 536-R, Senneterre", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "5e85af24aac0f1904d70a2fcee84f1b6f6912cc7450298af1f173002fd8e59df"} | |
| 6258 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e1f38e6b02f18b205ce94701", "attempt_id": "15f50fe3a956", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:12.376929Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 583, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13161.659458070062, "hops": {"1": 6860.111457994208, "2": 6301.548000075854}, "receiver_prefill_ms": 226.3869169401005, "ttft_ms": 11.981499963440001, "decode_ms": 83.10983295086771}, "total_wall_ms": 13483.626958099194, "ttft_ms": 11.981499963440001, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "88.7751", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "1e01e62c69f9479b681e50e59e8565c6583f5cdb803446a05ed5cb13118acdf9"} | |
| 6259 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "cb03c0eeb92823b5de9ce689", "attempt_id": "e193f3d41d46", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:12.713802Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 580, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13161.659458070062, "hops": {"1": 6860.111457994208, "2": 6301.548000075854}, "receiver_prefill_ms": 226.5225830487907, "ttft_ms": 11.911417008377612, "decode_ms": 11.882040998898447}, "total_wall_ms": 13412.46295813471, "ttft_ms": 11.911417008377612, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6260 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d68ae32727b36042d2ee7c59", "attempt_id": "61f45f0a2116", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:12.979220Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 587, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13161.659458070062, "hops": {"1": 6860.111457994208, "2": 6301.548000075854}, "receiver_prefill_ms": 226.67000000365078, "ttft_ms": 12.13691697921604, "decode_ms": 11.901833000592887}, "total_wall_ms": 13412.861917051487, "ttft_ms": 12.13691697921604, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6261 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "569e7bf5a4ec8f5c44cabea3", "attempt_id": "4d36945963de", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:13.245674Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 588, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13161.659458070062, "hops": {"1": 6860.111457994208, "2": 6301.548000075854}, "receiver_prefill_ms": 226.48012498393655, "ttft_ms": 11.998458998277783, "decode_ms": 131.08833401929587}, "total_wall_ms": 13531.844624085352, "ttft_ms": 11.998458998277783, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "BQ-59Z-6753", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "db250f072c856fe7ddf4bbbd16e20c71b8bad1eef5e4480acd0dac30f8ffe9cd"} | |
| 6262 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5439b7ea2f5d286c2f17ad45", "attempt_id": "7afd6978bee8", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:13.631115Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 578, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13161.659458070062, "hops": {"1": 6860.111457994208, "2": 6301.548000075854}, "receiver_prefill_ms": 225.67512502428144, "ttft_ms": 12.151958071626723, "decode_ms": 11.959291994571686}, "total_wall_ms": 13412.100958172232, "ttft_ms": 12.151958071626723, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | |
| 6263 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4ae060020ba2a575f6a79448", "attempt_id": "06ba95a72aba", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:13.896877Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 579, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13161.659458070062, "hops": {"1": 6860.111457994208, "2": 6301.548000075854}, "receiver_prefill_ms": 225.89400003198534, "ttft_ms": 12.093709083274007, "decode_ms": 11.991459061391652}, "total_wall_ms": 13412.250958150253, "ttft_ms": 12.093709083274007, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "yes", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "8a798890fe93817163b10b5f7bd2ca4d25d84c52739a645a889c173eee7d9d3d"} | |
| 6264 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "555fcc2c0601b06b6ea40726", "attempt_id": "c21c08f7425e", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:14.163548Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 595, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13161.659458070062, "hops": {"1": 6860.111457994208, "2": 6301.548000075854}, "receiver_prefill_ms": 226.92554094828665, "ttft_ms": 11.92904100753367, "decode_ms": 11.978833004832268}, "total_wall_ms": 13412.984083057381, "ttft_ms": 11.92904100753367, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6265 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ea6d7b1a40375117ca4a8985", "attempt_id": "dfd858c8d46d", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:14.430204Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 586, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13161.659458070062, "hops": {"1": 6860.111457994208, "2": 6301.548000075854}, "receiver_prefill_ms": 226.34762490633875, "ttft_ms": 11.899958946742117, "decode_ms": 11.99108303990215}, "total_wall_ms": 13412.35208301805, "ttft_ms": 11.899958946742117, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6266 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "777c33c64131b7f6665fa222", "attempt_id": "f9d9d7fa3a7f", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:14.695586Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 594, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13161.659458070062, "hops": {"1": 6860.111457994208, "2": 6301.548000075854}, "receiver_prefill_ms": 226.97137494105846, "ttft_ms": 11.974541936069727, "decode_ms": 59.44470898248255}, "total_wall_ms": 13460.535542108119, "ttft_ms": 11.974541936069727, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Kovar-9", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "c969b5f7547945067f5b07e9f822d0043126326f979d950a8b1b045057fbb818"} | |
| 6267 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9808688b5da67796aa80fe81", "attempt_id": "1b41db8d342e", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:15.009317Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 590, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13161.659458070062, "hops": {"1": 6860.111457994208, "2": 6301.548000075854}, "receiver_prefill_ms": 226.5684159938246, "ttft_ms": 11.967374943196774, "decode_ms": 94.82549992389977}, "total_wall_ms": 13495.493583148345, "ttft_ms": 11.967374943196774, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "13024817", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "672c00df3bfd31225e9d03325d167c25800a9007589a430995bacbf8ad8c6f21"} | |
| 6268 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "40c70859f27d25f58330e92b", "attempt_id": "73c2aa411d76", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:15.358163Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 585, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13161.659458070062, "hops": {"1": 6860.111457994208, "2": 6301.548000075854}, "receiver_prefill_ms": 226.84412507805973, "ttft_ms": 11.883749975822866, "decode_ms": 11.935291928239167}, "total_wall_ms": 13412.811083020642, "ttft_ms": 11.883749975822866, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6269 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f47aaff34d48a1545ac238ec", "attempt_id": "ec1a0206b938", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:15.625521Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 590, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13161.659458070062, "hops": {"1": 6860.111457994208, "2": 6301.548000075854}, "receiver_prefill_ms": 226.9573329249397, "ttft_ms": 11.8819170165807, "decode_ms": 11.953916982747614}, "total_wall_ms": 13412.913375068456, "ttft_ms": 11.8819170165807, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6270 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "16b41f5139a790c73426beec", "attempt_id": "e0c079376663", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:15.891792Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 592, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13161.659458070062, "hops": {"1": 6860.111457994208, "2": 6301.548000075854}, "receiver_prefill_ms": 226.9875839119777, "ttft_ms": 11.907708016224205, "decode_ms": 11.941958917304873}, "total_wall_ms": 13412.956041051075, "ttft_ms": 11.907708016224205, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6271 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "47dbca824955d1ae3187b5b2", "attempt_id": "4b33b63e5bab", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:28.732598Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 577, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 2238, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25733.930833172053, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966}, "receiver_prefill_ms": 208.80850008688867, "ttft_ms": 11.889124987646937, "decode_ms": 11.852832976728678}, "total_wall_ms": 25966.977458214387, "ttft_ms": 11.889124987646937, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6272 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5fbbe72094418704b950ce2c", "attempt_id": "2d751a26a233", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:28.980959Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 583, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 2238, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25733.930833172053, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966}, "receiver_prefill_ms": 226.34654201101512, "ttft_ms": 11.926042032428086, "decode_ms": 130.3043330553919}, "total_wall_ms": 26102.99900022801, "ttft_ms": 11.926042032428086, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 536-R, Senneterre", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "5e85af24aac0f1904d70a2fcee84f1b6f6912cc7450298af1f173002fd8e59df"} | |
| 6273 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "636b1db17d7394fa10e4db7b", "attempt_id": "676086342928", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:29.365158Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 583, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 2238, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25733.930833172053, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966}, "receiver_prefill_ms": 226.45491606090218, "ttft_ms": 12.106165988370776, "decode_ms": 82.95112499035895}, "total_wall_ms": 26055.92525016982, "ttft_ms": 12.106165988370776, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "88.7751", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "1e01e62c69f9479b681e50e59e8565c6583f5cdb803446a05ed5cb13118acdf9"} | |
| 6274 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9752381593d9c22229f9dad1", "attempt_id": "634285066f0d", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:29.701866Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 580, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 2238, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25733.930833172053, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966}, "receiver_prefill_ms": 226.81824991013855, "ttft_ms": 12.0340830180794, "decode_ms": 11.84329204261303}, "total_wall_ms": 25985.095583135262, "ttft_ms": 12.0340830180794, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6275 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0376c88c828bef134fbed9da", "attempt_id": "a2d2f553b9cf", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:29.967992Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 587, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 2238, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25733.930833172053, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966}, "receiver_prefill_ms": 226.58925002906471, "ttft_ms": 11.893625021912158, "decode_ms": 12.020291993394494}, "total_wall_ms": 25984.889708226547, "ttft_ms": 11.893625021912158, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6276 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f3a2ad21e7faa465c057bd52", "attempt_id": "56135811360c", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:30.233621Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 588, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 2238, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25733.930833172053, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966}, "receiver_prefill_ms": 226.74441698472947, "ttft_ms": 11.915334034711123, "decode_ms": 130.16837497707456}, "total_wall_ms": 26103.23541611433, "ttft_ms": 11.915334034711123, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "BQ-59Z-6753", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "db250f072c856fe7ddf4bbbd16e20c71b8bad1eef5e4480acd0dac30f8ffe9cd"} | |
| 6277 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a7e0415503bc1b18c154e71f", "attempt_id": "e2d867779f60", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:30.617805Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 578, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 2238, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25733.930833172053, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966}, "receiver_prefill_ms": 226.10416694078594, "ttft_ms": 11.85033400543034, "decode_ms": 12.1004160027951}, "total_wall_ms": 25984.432583092712, "ttft_ms": 11.85033400543034, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | |
| 6278 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "81cfa9d8f3ba1008aa6ebf45", "attempt_id": "2e2ab8e694c1", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:30.883044Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 579, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 2238, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25733.930833172053, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966}, "receiver_prefill_ms": 226.06004192493856, "ttft_ms": 11.915459064766765, "decode_ms": 11.863666004501283}, "total_wall_ms": 25984.224875224754, "ttft_ms": 11.915459064766765, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "yes", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "8a798890fe93817163b10b5f7bd2ca4d25d84c52739a645a889c173eee7d9d3d"} | |
| 6279 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "798d6eab719c01d6fa323a5d", "attempt_id": "cde957380797", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:31.148078Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 595, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 2238, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25733.930833172053, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966}, "receiver_prefill_ms": 226.8334999680519, "ttft_ms": 11.853165924549103, "decode_ms": 11.917417054064572}, "total_wall_ms": 25985.012792167254, "ttft_ms": 11.853165924549103, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6280 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "6f56a31eb6966de70cf5c503", "attempt_id": "c3315cc70b5f", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:31.414421Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 586, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 2238, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25733.930833172053, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966}, "receiver_prefill_ms": 226.39208403415978, "ttft_ms": 11.858208919875324, "decode_ms": 11.979374918155372}, "total_wall_ms": 25984.62350014597, "ttft_ms": 11.858208919875324, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6281 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "673baaca5ce68b663c4407c9", "attempt_id": "2d060ba1290a", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:31.680363Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 594, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 2238, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25733.930833172053, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966}, "receiver_prefill_ms": 226.7625000094995, "ttft_ms": 11.84979104436934, "decode_ms": 59.57145907450467}, "total_wall_ms": 26032.5781252468, "ttft_ms": 11.84979104436934, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Kovar-9", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "c969b5f7547945067f5b07e9f822d0043126326f979d950a8b1b045057fbb818"} | |
| 6282 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "bbd43850f5370d90b0173997", "attempt_id": "e3d42e35d164", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:31.993892Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 590, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 2238, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25733.930833172053, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966}, "receiver_prefill_ms": 226.64541599806398, "ttft_ms": 11.909915949217975, "decode_ms": 95.06816603243351}, "total_wall_ms": 26068.139667157084, "ttft_ms": 11.909915949217975, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "13024817", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "672c00df3bfd31225e9d03325d167c25800a9007589a430995bacbf8ad8c6f21"} | |
| 6283 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ab4374f3eb03b45bd89473a7", "attempt_id": "701953fa6c1b", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:32.342938Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 585, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 2238, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25733.930833172053, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966}, "receiver_prefill_ms": 225.72845791000873, "ttft_ms": 12.108584051020443, "decode_ms": 11.9452920043841}, "total_wall_ms": 25984.325875062495, "ttft_ms": 12.108584051020443, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6284 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "028d9e49e3548ba4b7b15965", "attempt_id": "12e58e6b60d0", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:32.608407Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 590, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 2238, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25733.930833172053, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966}, "receiver_prefill_ms": 226.51729197241366, "ttft_ms": 11.971124913543463, "decode_ms": 12.001250055618584}, "total_wall_ms": 25984.878625255078, "ttft_ms": 11.971124913543463, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6285 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "bb7fcd436e6930e9dc5471f4", "attempt_id": "6c8911670c59", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:32.874665Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 592, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 2238, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25733.930833172053, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966}, "receiver_prefill_ms": 226.58804105594754, "ttft_ms": 11.91033294890076, "decode_ms": 11.964667006395757}, "total_wall_ms": 25984.893624205142, "ttft_ms": 11.91033294890076, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6286 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4e3fe79b117646c8676c65d0", "attempt_id": "fb80622b766e", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:58.272129Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 577, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 5222, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 50860.583542031236, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966, "5": 6284.2733329162, "6": 6280.639917007647, "7": 6281.036333995871, "8": 6280.703124939464}, "receiver_prefill_ms": 208.69258395396173, "ttft_ms": 11.884875013493001, "decode_ms": 11.874084011651576}, "total_wall_ms": 51093.529292033054, "ttft_ms": 11.884875013493001, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "5": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "6": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "7": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "8": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6287 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b99d21b2d0bfc02fbbefdcb8", "attempt_id": "a04ee8808f84", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:58.520777Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 583, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 5222, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 50860.583542031236, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966, "5": 6284.2733329162, "6": 6280.639917007647, "7": 6281.036333995871, "8": 6280.703124939464}, "receiver_prefill_ms": 226.50037507992238, "ttft_ms": 11.87854097224772, "decode_ms": 130.59416692703962}, "total_wall_ms": 51230.06037506275, "ttft_ms": 11.87854097224772, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 536-R, Senneterre", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "5": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "6": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "7": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "8": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "5e85af24aac0f1904d70a2fcee84f1b6f6912cc7450298af1f173002fd8e59df"} | |
| 6288 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "fdb50f2b66efd8c03eeebc15", "attempt_id": "f04eb326e10a", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:58.905448Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 583, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 5222, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 50860.583542031236, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966, "5": 6284.2733329162, "6": 6280.639917007647, "7": 6281.036333995871, "8": 6280.703124939464}, "receiver_prefill_ms": 226.56700003426522, "ttft_ms": 11.946541955694556, "decode_ms": 82.96749996952713}, "total_wall_ms": 51182.533667073585, "ttft_ms": 11.946541955694556, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "88.7751", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "5": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "6": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "7": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "8": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "1e01e62c69f9479b681e50e59e8565c6583f5cdb803446a05ed5cb13118acdf9"} | |
| 6289 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "6d679d27a5f7afc5d3084456", "attempt_id": "4d333eabca8e", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:59.242133Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 580, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 5222, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 50860.583542031236, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966, "5": 6284.2733329162, "6": 6280.639917007647, "7": 6281.036333995871, "8": 6280.703124939464}, "receiver_prefill_ms": 225.9958341019228, "ttft_ms": 11.976291076280177, "decode_ms": 11.83108298573643}, "total_wall_ms": 51110.87299999781, "ttft_ms": 11.976291076280177, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "5": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "6": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "7": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "8": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6290 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5c86d699770928bf84c3c791", "attempt_id": "ee4abff82877", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:59.507138Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 587, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 5222, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 50860.583542031236, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966, "5": 6284.2733329162, "6": 6280.639917007647, "7": 6281.036333995871, "8": 6280.703124939464}, "receiver_prefill_ms": 226.3192079262808, "ttft_ms": 12.070041964761913, "decode_ms": 11.930875014513731}, "total_wall_ms": 51111.36558302678, "ttft_ms": 12.070041964761913, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "5": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "6": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "7": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "8": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6291 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "cfae9e6ec10ad8e3ded42592", "attempt_id": "121fceb1df67", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:59.772630Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 588, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 5222, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 50860.583542031236, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966, "5": 6284.2733329162, "6": 6280.639917007647, "7": 6281.036333995871, "8": 6280.703124939464}, "receiver_prefill_ms": 226.77674994338304, "ttft_ms": 12.181833968497813, "decode_ms": 131.2990830047056}, "total_wall_ms": 51231.40708403662, "ttft_ms": 12.181833968497813, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "BQ-59Z-6753", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "5": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "6": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "7": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "8": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "db250f072c856fe7ddf4bbbd16e20c71b8bad1eef5e4480acd0dac30f8ffe9cd"} | |
| 6292 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7996816ebde05369c712c59d", "attempt_id": "a68ad8d9efb1", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:00.158309Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 578, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 5222, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 50860.583542031236, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966, "5": 6284.2733329162, "6": 6280.639917007647, "7": 6281.036333995871, "8": 6280.703124939464}, "receiver_prefill_ms": 225.8157500764355, "ttft_ms": 11.92099996842444, "decode_ms": 11.865791981108487}, "total_wall_ms": 51110.675751115195, "ttft_ms": 11.92099996842444, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "5": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "6": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "7": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "8": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | |
| 6293 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "49a0c8f91f796305ff856c8b", "attempt_id": "d34aa3289eb0", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:00.423596Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 579, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 5222, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 50860.583542031236, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966, "5": 6284.2733329162, "6": 6280.639917007647, "7": 6281.036333995871, "8": 6280.703124939464}, "receiver_prefill_ms": 226.30445798859, "ttft_ms": 12.106165988370776, "decode_ms": 11.934584006667137}, "total_wall_ms": 51111.38970812317, "ttft_ms": 12.106165988370776, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "yes", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "5": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "6": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "7": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "8": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "8a798890fe93817163b10b5f7bd2ca4d25d84c52739a645a889c173eee7d9d3d"} | |
| 6294 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "8ea2c2bb519b47b7e2e55a3d", "attempt_id": "cfbf2567603c", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:00.689159Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 595, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 5222, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 50860.583542031236, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966, "5": 6284.2733329162, "6": 6280.639917007647, "7": 6281.036333995871, "8": 6280.703124939464}, "receiver_prefill_ms": 226.98754200246185, "ttft_ms": 11.919333948753774, "decode_ms": 11.920499964617193}, "total_wall_ms": 51111.89204198308, "ttft_ms": 11.919333948753774, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "5": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "6": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "7": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "8": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6295 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0167a7006f01719d616eb409", "attempt_id": "f61a511130c5", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:00.955316Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 586, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 5222, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 50860.583542031236, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966, "5": 6284.2733329162, "6": 6280.639917007647, "7": 6281.036333995871, "8": 6280.703124939464}, "receiver_prefill_ms": 226.63349995855242, "ttft_ms": 11.85654103755951, "decode_ms": 11.883166967891157}, "total_wall_ms": 51111.41916702036, "ttft_ms": 11.85654103755951, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "5": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "6": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "7": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "8": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6296 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "da4946f419698264580b92a1", "attempt_id": "7f552d794ce9", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:01.220838Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 594, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 5222, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 50860.583542031236, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966, "5": 6284.2733329162, "6": 6280.639917007647, "7": 6281.036333995871, "8": 6280.703124939464}, "receiver_prefill_ms": 227.0756249781698, "ttft_ms": 11.885665939189494, "decode_ms": 59.61816699709743}, "total_wall_ms": 51159.6483750036, "ttft_ms": 11.885665939189494, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Kovar-9", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "5": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "6": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "7": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "8": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "c969b5f7547945067f5b07e9f822d0043126326f979d950a8b1b045057fbb818"} | |
| 6297 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "80ae66646370c00342102a8d", "attempt_id": "d18af4a3b85d", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:01.534430Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 590, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 5222, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 50860.583542031236, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966, "5": 6284.2733329162, "6": 6280.639917007647, "7": 6281.036333995871, "8": 6280.703124939464}, "receiver_prefill_ms": 226.76312504336238, "ttft_ms": 11.779709020629525, "decode_ms": 95.16625001560897}, "total_wall_ms": 51194.89991699811, "ttft_ms": 11.779709020629525, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "13024817", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "5": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "6": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "7": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "8": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "672c00df3bfd31225e9d03325d167c25800a9007589a430995bacbf8ad8c6f21"} | |
| 6298 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "1b9af61640909b3879536487", "attempt_id": "6ada368df423", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:01.883642Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 585, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 5222, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 50860.583542031236, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966, "5": 6284.2733329162, "6": 6280.639917007647, "7": 6281.036333995871, "8": 6280.703124939464}, "receiver_prefill_ms": 226.4832080109045, "ttft_ms": 11.929625063203275, "decode_ms": 11.864207917824388}, "total_wall_ms": 51111.36079195421, "ttft_ms": 11.929625063203275, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "5": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "6": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "7": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "8": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6299 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e15e5250ce71ddcc2658ebf3", "attempt_id": "4cfacac919cb", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:02.150036Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 590, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 5222, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 50860.583542031236, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966, "5": 6284.2733329162, "6": 6280.639917007647, "7": 6281.036333995871, "8": 6280.703124939464}, "receiver_prefill_ms": 226.6715409932658, "ttft_ms": 11.828834074549377, "decode_ms": 11.788082891143858}, "total_wall_ms": 51111.34495900478, "ttft_ms": 11.828834074549377, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "5": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "6": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "7": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "8": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6300 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "fa40e97d71123f2aa82a925c", "attempt_id": "cb55cfe2065c", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:02.415622Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 592, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 5222, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 50860.583542031236, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966, "5": 6284.2733329162, "6": 6280.639917007647, "7": 6281.036333995871, "8": 6280.703124939464}, "receiver_prefill_ms": 226.70029196888208, "ttft_ms": 12.28158304002136, "decode_ms": 12.00774998869747}, "total_wall_ms": 51112.22091712989, "ttft_ms": 12.28158304002136, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "5": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "6": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "7": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "8": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6301 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7002b67bf9eb2768afd17adb", "attempt_id": "fe8d1440d3d3", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:09.542305Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 460, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6858.334750053473, "hops": {"1": 6858.334750053473}, "receiver_prefill_ms": 185.85645803250372, "ttft_ms": 11.812999960966408, "decode_ms": 11.776375002227724}, "total_wall_ms": 7068.241458036937, "ttft_ms": 11.812999960966408, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6302 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e66adc333f2567da560f1834", "attempt_id": "c06f66d4b144", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:09.768114Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 466, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6858.334750053473, "hops": {"1": 6858.334750053473}, "receiver_prefill_ms": 186.04087503626943, "ttft_ms": 11.82437501847744, "decode_ms": 11.819040984846652}, "total_wall_ms": 7068.433833075687, "ttft_ms": 11.82437501847744, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6303 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "056fe6d894d6b00f9a6e892f", "attempt_id": "1946bf0fb03a", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:09.993313Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 466, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6858.334750053473, "hops": {"1": 6858.334750053473}, "receiver_prefill_ms": 186.19808298535645, "ttft_ms": 11.798167019151151, "decode_ms": 12.033750070258975}, "total_wall_ms": 7068.761625094339, "ttft_ms": 11.798167019151151, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6304 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "3db0368256e4ba413236b871", "attempt_id": "15451b002a81", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:10.218798Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 463, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6858.334750053473, "hops": {"1": 6858.334750053473}, "receiver_prefill_ms": 186.48212496191263, "ttft_ms": 11.84791699051857, "decode_ms": 11.852917028591037}, "total_wall_ms": 7068.891209084541, "ttft_ms": 11.84791699051857, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6305 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "59aba285ef0deddc647f3aff", "attempt_id": "42307132b7d3", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:10.444118Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 470, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6858.334750053473, "hops": {"1": 6858.334750053473}, "receiver_prefill_ms": 186.20070908218622, "ttft_ms": 11.832916992716491, "decode_ms": 11.83708303142339}, "total_wall_ms": 7068.597042001784, "ttft_ms": 11.832916992716491, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6306 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "75f6d2adb964af62f2497c9f", "attempt_id": "daf9373e657b", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:10.669199Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 471, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6858.334750053473, "hops": {"1": 6858.334750053473}, "receiver_prefill_ms": 186.63504195865244, "ttft_ms": 11.767458054237068, "decode_ms": 117.8340419428423}, "total_wall_ms": 7174.971708096564, "ttft_ms": 11.767458054237068, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "MH-96F-2099", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "95c230d14a055d30e0e1d4355caf07808e1c968b1feab9e0607d8bd37b1b43dc"} | |
| 6307 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "3ff94bbdd1ac08e151c22d66", "attempt_id": "219a3b766dfe", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:11.000924Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 461, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6858.334750053473, "hops": {"1": 6858.334750053473}, "receiver_prefill_ms": 186.40212493482977, "ttft_ms": 11.827416019514203, "decode_ms": 11.863624909892678}, "total_wall_ms": 7068.831958109513, "ttft_ms": 11.827416019514203, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | |
| 6308 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "018ba3cc8c9a8cee768e2a80", "attempt_id": "b32d7dec6bc5", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:11.226520Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 462, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6858.334750053473, "hops": {"1": 6858.334750053473}, "receiver_prefill_ms": 186.41974998172373, "ttft_ms": 11.842958047054708, "decode_ms": 11.901790974661708}, "total_wall_ms": 7068.881749990396, "ttft_ms": 11.842958047054708, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | |
| 6309 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "277d6954f787cd5d446f40a6", "attempt_id": "c6f0c2be24bd", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:11.452007Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 478, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6858.334750053473, "hops": {"1": 6858.334750053473}, "receiver_prefill_ms": 186.70491699595004, "ttft_ms": 11.804500012658536, "decode_ms": 11.74224994610995}, "total_wall_ms": 7068.991417065263, "ttft_ms": 11.804500012658536, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6310 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0b7f796434eadb85d1e52c8d", "attempt_id": "4d0a28b5c62d", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:11.677314Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 469, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6858.334750053473, "hops": {"1": 6858.334750053473}, "receiver_prefill_ms": 185.86433306336403, "ttft_ms": 11.796500068157911, "decode_ms": 82.50654197763652}, "total_wall_ms": 7138.8948750682175, "ttft_ms": 11.796500068157911, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5646720", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "e1d129e860627cf4623671ed186cb4ebbf5d63169d3d0dc14a62e1da2af61326"} | |
| 6311 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f2453af5a0ddc4ce71907a99", "attempt_id": "6955e20a5988", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:11.972728Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 477, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6858.334750053473, "hops": {"1": 6858.334750053473}, "receiver_prefill_ms": 186.30929209757596, "ttft_ms": 11.884625069797039, "decode_ms": 58.9661659905687}, "total_wall_ms": 7115.869125118479, "ttft_ms": 11.884625069797039, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Kovar-9", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "c969b5f7547945067f5b07e9f822d0043126326f979d950a8b1b045057fbb818"} | |
| 6312 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f836d7809ff3f93d6c0488a1", "attempt_id": "d2acd35d4fdb", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:12.244916Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 473, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6858.334750053473, "hops": {"1": 6858.334750053473}, "receiver_prefill_ms": 186.15483306348324, "ttft_ms": 11.910791974514723, "decode_ms": 82.62462494894862}, "total_wall_ms": 7139.431458082981, "ttft_ms": 11.910791974514723, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "9484825", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "667b970507c4c6c7fb572757eb3b5eb04186ddb67a6ef680266b7a0924737993"} | |
| 6313 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7b5d98d0561e060d6ec4e5f7", "attempt_id": "30aedc46933a", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:12.541145Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 468, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6858.334750053473, "hops": {"1": 6858.334750053473}, "receiver_prefill_ms": 185.08358299732208, "ttft_ms": 11.85133308172226, "decode_ms": 47.42800001986325}, "total_wall_ms": 7103.088417090476, "ttft_ms": 11.85133308172226, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "22.3", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "8afb0bb35e730fd32e7805d65081241bd21f43709df37165f4ec91c763f8a99d"} | |
| 6314 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f88746fbc36c8068ed7d1ffa", "attempt_id": "48a2686128e3", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:12.800718Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 473, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6858.334750053473, "hops": {"1": 6858.334750053473}, "receiver_prefill_ms": 186.2459999974817, "ttft_ms": 11.850791983306408, "decode_ms": 11.878332938067615}, "total_wall_ms": 7068.681875127368, "ttft_ms": 11.850791983306408, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6315 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b5323b1dbad8832a4b42b95b", "attempt_id": "4d364c2e7123", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:13.025886Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 475, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6858.334750053473, "hops": {"1": 6858.334750053473}, "receiver_prefill_ms": 186.4105419954285, "ttft_ms": 11.826083064079285, "decode_ms": 11.851917020976543}, "total_wall_ms": 7068.8043751288205, "ttft_ms": 11.826083064079285, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6316 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4e6cbc70328e25c8357cf35b", "attempt_id": "256aa5c2e015", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:18.228976Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 469, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 497, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11834.982667001896, "hops": {"1": 6858.334750053473, "2": 4976.647916948423}, "receiver_prefill_ms": 186.03099999018013, "ttft_ms": 11.82962500024587, "decode_ms": 11.953708017244935}, "total_wall_ms": 12045.24783405941, "ttft_ms": 11.82962500024587, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6317 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7d2c180a1c7770a34353ebea", "attempt_id": "1b45fcde11d4", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:18.455315Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 475, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 497, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11834.982667001896, "hops": {"1": 6858.334750053473, "2": 4976.647916948423}, "receiver_prefill_ms": 185.98220800049603, "ttft_ms": 11.92508393432945, "decode_ms": 11.82125008199364}, "total_wall_ms": 12045.16641702503, "ttft_ms": 11.92508393432945, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6318 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4065a27e12390281dc1a284d", "attempt_id": "8d1669b73dd2", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:18.680748Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 475, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 497, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11834.982667001896, "hops": {"1": 6858.334750053473, "2": 4976.647916948423}, "receiver_prefill_ms": 186.37154099997133, "ttft_ms": 11.898875003680587, "decode_ms": 11.90529193263501}, "total_wall_ms": 12045.558709069155, "ttft_ms": 11.898875003680587, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6319 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c1aaf0deef0986db8d193e60", "attempt_id": "3cd5be4201c1", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:18.906734Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 472, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 497, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11834.982667001896, "hops": {"1": 6858.334750053473, "2": 4976.647916948423}, "receiver_prefill_ms": 186.2717499025166, "ttft_ms": 11.856916011311114, "decode_ms": 11.921083088964224}, "total_wall_ms": 12045.455584069714, "ttft_ms": 11.856916011311114, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6320 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "252e4c859c4a0d299f7534e9", "attempt_id": "6deedad5e522", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:19.131823Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 479, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 497, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11834.982667001896, "hops": {"1": 6858.334750053473, "2": 4976.647916948423}, "receiver_prefill_ms": 186.42104207538068, "ttft_ms": 11.926540988497436, "decode_ms": 11.951540946029127}, "total_wall_ms": 12045.738041982986, "ttft_ms": 11.926540988497436, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6321 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a21420be37a7f74a720ff260", "attempt_id": "f5dca43f25c8", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:19.357510Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 480, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 497, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11834.982667001896, "hops": {"1": 6858.334750053473, "2": 4976.647916948423}, "receiver_prefill_ms": 186.9509998941794, "ttft_ms": 11.850583949126303, "decode_ms": 11.91483298316598}, "total_wall_ms": 12046.148416935466, "ttft_ms": 11.850583949126303, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6322 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "94c80fa0c3585f8f9a6a4371", "attempt_id": "06c04ad86cff", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:19.583359Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 470, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 497, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11834.982667001896, "hops": {"1": 6858.334750053473, "2": 4976.647916948423}, "receiver_prefill_ms": 185.8234580140561, "ttft_ms": 11.889416025951505, "decode_ms": 11.819042032584548}, "total_wall_ms": 12044.914458063431, "ttft_ms": 11.889416025951505, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | |
| 6323 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "13920be4e8b3077047f4bcb1", "attempt_id": "ca2e4b7fb25e", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:19.808278Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 471, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 497, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11834.982667001896, "hops": {"1": 6858.334750053473, "2": 4976.647916948423}, "receiver_prefill_ms": 185.40650000795722, "ttft_ms": 11.837625061161816, "decode_ms": 12.097875005565584}, "total_wall_ms": 12044.712999952026, "ttft_ms": 11.837625061161816, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | |
| 6324 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f1e1bde8d469b9511959f7dd", "attempt_id": "3b5ca0e31235", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:20.032809Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 487, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 497, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11834.982667001896, "hops": {"1": 6858.334750053473, "2": 4976.647916948423}, "receiver_prefill_ms": 187.7643340267241, "ttft_ms": 12.007332989014685, "decode_ms": 11.868707952089608}, "total_wall_ms": 12047.183291986585, "ttft_ms": 12.007332989014685, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6325 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "626fc8db67d1025bfd518da4", "attempt_id": "185429d9d04f", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:20.259865Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 478, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 497, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11834.982667001896, "hops": {"1": 6858.334750053473, "2": 4976.647916948423}, "receiver_prefill_ms": 186.68425001669675, "ttft_ms": 12.029709061607718, "decode_ms": 11.898832977749407}, "total_wall_ms": 12046.112125040963, "ttft_ms": 12.029709061607718, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6326 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "fd4d061eb9a4a8b88d58adca", "attempt_id": "4381706f570f", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:20.487599Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 486, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 497, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11834.982667001896, "hops": {"1": 6858.334750053473, "2": 4976.647916948423}, "receiver_prefill_ms": 188.31787491217256, "ttft_ms": 11.744957999326289, "decode_ms": 59.13312500342727}, "total_wall_ms": 12094.612958026119, "ttft_ms": 11.744957999326289, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Kovar-9", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "c969b5f7547945067f5b07e9f822d0043126326f979d950a8b1b045057fbb818"} | |
| 6327 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "bcbac3d81b7e97b6b137539c", "attempt_id": "aba4e720a3a9", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:20.762724Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 482, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 497, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11834.982667001896, "hops": {"1": 6858.334750053473, "2": 4976.647916948423}, "receiver_prefill_ms": 184.85312501434237, "ttft_ms": 11.861666920594871, "decode_ms": 71.2572910124436}, "total_wall_ms": 12103.36525097955, "ttft_ms": 11.861666920594871, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "948485", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "244f716d260fa5f07cbedd5d728983a25a4991af5624be73b358ad829974e9c4"} | |
| 6328 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f3de17234aeea84dd5b95577", "attempt_id": "c15b8c38d8ec", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:21.046208Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 477, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 497, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11834.982667001896, "hops": {"1": 6858.334750053473, "2": 4976.647916948423}, "receiver_prefill_ms": 186.66945898439735, "ttft_ms": 11.865791049785912, "decode_ms": 47.31558298226446}, "total_wall_ms": 12081.220626016147, "ttft_ms": 11.865791049785912, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "22.3", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "8afb0bb35e730fd32e7805d65081241bd21f43709df37165f4ec91c763f8a99d"} | |
| 6329 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a81ec4ec9bd3a601e58289fe", "attempt_id": "40dbfa1c2926", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:21.307238Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 482, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 497, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11834.982667001896, "hops": {"1": 6858.334750053473, "2": 4976.647916948423}, "receiver_prefill_ms": 183.93512489274144, "ttft_ms": 11.840457911603153, "decode_ms": 11.890291003510356}, "total_wall_ms": 12043.01712603774, "ttft_ms": 11.840457911603153, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6330 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b069866f2a9d4a0469f8926e", "attempt_id": "d95444748c58", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:21.529885Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 484, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 497, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11834.982667001896, "hops": {"1": 6858.334750053473, "2": 4976.647916948423}, "receiver_prefill_ms": 184.3267499934882, "ttft_ms": 12.121375068090856, "decode_ms": 11.842624982818961}, "total_wall_ms": 12043.780250940472, "ttft_ms": 12.121375068090856, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6331 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "dfa2aa0a6797ae01ac3bb479", "attempt_id": "2e5c39521ba7", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:31.702812Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 469, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 1491, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21781.92445903551, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824}, "receiver_prefill_ms": 185.75866695027798, "ttft_ms": 11.88416697550565, "decode_ms": 11.851958930492401}, "total_wall_ms": 21991.85891705565, "ttft_ms": 11.88416697550565, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6332 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "15a75188a5ffb34386213b74", "attempt_id": "73a93a1758d3", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:31.928435Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 475, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 1491, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21781.92445903551, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824}, "receiver_prefill_ms": 185.9312909655273, "ttft_ms": 11.89075002912432, "decode_ms": 11.830749921500683}, "total_wall_ms": 21992.001833976246, "ttft_ms": 11.89075002912432, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6333 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "eba8144f5bd7dde0d3a2d64c", "attempt_id": "a941fdee95e0", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:32.153994Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 475, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 1491, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21781.92445903551, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824}, "receiver_prefill_ms": 186.0080419573933, "ttft_ms": 11.859874939545989, "decode_ms": 11.83879200834781}, "total_wall_ms": 21992.018583929166, "ttft_ms": 11.859874939545989, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6334 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f724d68fa8bcbe7d6e1577d2", "attempt_id": "4f84aeec5f94", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:32.378976Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 472, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 1491, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21781.92445903551, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824}, "receiver_prefill_ms": 185.7952909776941, "ttft_ms": 11.80870900861919, "decode_ms": 11.859916034154594}, "total_wall_ms": 21991.88129301183, "ttft_ms": 11.80870900861919, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6335 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "36a85823539f6a10202e88a7", "attempt_id": "127c2829dc22", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:32.603630Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 479, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 1491, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21781.92445903551, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824}, "receiver_prefill_ms": 186.8701659841463, "ttft_ms": 12.091000098735094, "decode_ms": 12.0086669921875}, "total_wall_ms": 21993.4917089995, "ttft_ms": 12.091000098735094, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6336 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "37830f8f492bf43790a4f5cd", "attempt_id": "b5793ea260aa", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:32.830677Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 480, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 1491, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21781.92445903551, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824}, "receiver_prefill_ms": 186.83437502477318, "ttft_ms": 11.896374984644353, "decode_ms": 118.63562499638647}, "total_wall_ms": 22099.718958954327, "ttft_ms": 11.896374984644353, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "MH-96F-2099", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "95c230d14a055d30e0e1d4355caf07808e1c968b1feab9e0607d8bd37b1b43dc"} | |
| 6337 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "1b4a1c5c1a5cb96858488e5c", "attempt_id": "083ea0124ec7", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:33.163667Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 470, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 1491, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21781.92445903551, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824}, "receiver_prefill_ms": 186.04454200249165, "ttft_ms": 12.004374992102385, "decode_ms": 12.01070798560977}, "total_wall_ms": 21992.376458947547, "ttft_ms": 12.004374992102385, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | |
| 6338 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "382141b8893e0a3ed2316441", "attempt_id": "050db41f693c", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:33.388935Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 471, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 1491, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21781.92445903551, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824}, "receiver_prefill_ms": 186.2477499525994, "ttft_ms": 11.954624904319644, "decode_ms": 11.891416972503066}, "total_wall_ms": 21992.477542953566, "ttft_ms": 11.954624904319644, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | |
| 6339 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "29696173109d11f819ab2338", "attempt_id": "b43101214d10", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:33.614253Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 487, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 1491, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21781.92445903551, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824}, "receiver_prefill_ms": 188.15254094079137, "ttft_ms": 11.985791963525116, "decode_ms": 11.900500045157969}, "total_wall_ms": 21994.395583984442, "ttft_ms": 11.985791963525116, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6340 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5ad9569a760a8b4a55e2f797", "attempt_id": "66a285a6515c", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:33.842033Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 478, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 1491, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21781.92445903551, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824}, "receiver_prefill_ms": 186.2962500890717, "ttft_ms": 11.930083041079342, "decode_ms": 82.44408294558525}, "total_wall_ms": 22063.01591708325, "ttft_ms": 11.930083041079342, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5646720", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "e1d129e860627cf4623671ed186cb4ebbf5d63169d3d0dc14a62e1da2af61326"} | |
| 6341 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "028a9e0044c5d46d286f6fed", "attempt_id": "60c5a1ca23d5", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:34.138017Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 486, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 1491, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21781.92445903551, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824}, "receiver_prefill_ms": 187.87783302832395, "ttft_ms": 12.163541978225112, "decode_ms": 59.53324993606657}, "total_wall_ms": 22042.043125955388, "ttft_ms": 12.163541978225112, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Kovar-9", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "c969b5f7547945067f5b07e9f822d0043126326f979d950a8b1b045057fbb818"} | |
| 6342 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "527e2d10941436d9843e61a1", "attempt_id": "c592b95a8f96", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:34.413111Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 482, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 1491, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21781.92445903551, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824}, "receiver_prefill_ms": 183.64629102870822, "ttft_ms": 12.180499965324998, "decode_ms": 71.41625008080155}, "total_wall_ms": 22049.708334030584, "ttft_ms": 12.180499965324998, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "948485", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "244f716d260fa5f07cbedd5d728983a25a4991af5624be73b358ad829974e9c4"} | |
| 6343 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "aeae98ccabe2505393002aa1", "attempt_id": "766c03efe5d0", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:34.696891Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 477, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 1491, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21781.92445903551, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824}, "receiver_prefill_ms": 186.47487496491522, "ttft_ms": 11.89762493595481, "decode_ms": 47.2524999640882}, "total_wall_ms": 22027.974458993413, "ttft_ms": 11.89762493595481, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "22.3", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "8afb0bb35e730fd32e7805d65081241bd21f43709df37165f4ec91c763f8a99d"} | |
| 6344 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5c41f0753cb706d74e42b6b3", "attempt_id": "c4ac4a286d9f", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:34.958329Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 482, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 1491, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21781.92445903551, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824}, "receiver_prefill_ms": 184.58412494510412, "ttft_ms": 11.8815409950912, "decode_ms": 11.83712505735457}, "total_wall_ms": 21990.61270907987, "ttft_ms": 11.8815409950912, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6345 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "8d38122e717d899535c9eb40", "attempt_id": "38249278f441", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:35.181575Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 484, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 1491, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21781.92445903551, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824}, "receiver_prefill_ms": 184.33633400127292, "ttft_ms": 12.082625064067543, "decode_ms": 11.769582983106375}, "total_wall_ms": 21990.528916940093, "ttft_ms": 12.082625064067543, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6346 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0a5e8c30bfca2b101baa1e68", "attempt_id": "b78523874eab", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:28.022760Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 469, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 3479, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 74394.34491703287, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824, "5": 4970.625541987829, "6": 7763.661833014339, "7": 19990.075874957256, "8": 19888.057208037935}, "receiver_prefill_ms": 340.0229170219973, "ttft_ms": 45.39320897310972, "decode_ms": 45.83379102405161}, "total_wall_ms": 74826.11566700507, "ttft_ms": 45.39320897310972, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6347 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9a683658fa9392dd17ce6440", "attempt_id": "eb547cf2883a", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:28.472013Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 475, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 3479, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 74394.34491703287, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824, "5": 4970.625541987829, "6": 7763.661833014339, "7": 19990.075874957256, "8": 19888.057208037935}, "receiver_prefill_ms": 352.55520802456886, "ttft_ms": 40.868874988518655, "decode_ms": 49.819333013147116}, "total_wall_ms": 74838.15391699318, "ttft_ms": 40.868874988518655, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6348 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "8fb2dac235b6f6ce7584c34b", "attempt_id": "d2685afb6944", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:28.932361Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 475, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 3479, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 74394.34491703287, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824, "5": 4970.625541987829, "6": 7763.661833014339, "7": 19990.075874957256, "8": 19888.057208037935}, "receiver_prefill_ms": 349.36150000430644, "ttft_ms": 45.4847919754684, "decode_ms": 45.87041598279029}, "total_wall_ms": 74835.56275104638, "ttft_ms": 45.4847919754684, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6349 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a9f593f2ff39fcf69b942f42", "attempt_id": "6d7e7ec41a6c", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:29.390259Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 472, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 3479, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 74394.34491703287, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824, "5": 4970.625541987829, "6": 7763.661833014339, "7": 19990.075874957256, "8": 19888.057208037935}, "receiver_prefill_ms": 347.4786669248715, "ttft_ms": 43.20362501312047, "decode_ms": 43.96199993789196}, "total_wall_ms": 74829.48395900894, "ttft_ms": 43.20362501312047, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6350 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ad0f49cc3de245521249fc25", "attempt_id": "21cfa4f1a7f0", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:29.841743Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 479, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 3479, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 74394.34491703287, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824, "5": 4970.625541987829, "6": 7763.661833014339, "7": 19990.075874957256, "8": 19888.057208037935}, "receiver_prefill_ms": 352.6987920049578, "ttft_ms": 43.187833041884005, "decode_ms": 42.309709009714425}, "total_wall_ms": 74833.044292056, "ttft_ms": 43.187833041884005, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6351 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "3502e86bf97404a55715cc00", "attempt_id": "e0d344a6d861", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:30.297083Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 480, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 3479, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 74394.34491703287, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824, "5": 4970.625541987829, "6": 7763.661833014339, "7": 19990.075874957256, "8": 19888.057208037935}, "receiver_prefill_ms": 345.83670797292143, "ttft_ms": 42.64020803384483, "decode_ms": 44.390999944880605}, "total_wall_ms": 74827.73033308331, "ttft_ms": 42.64020803384483, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6352 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "8ac43d333871d75b68cd3c0e", "attempt_id": "9fa8def0c378", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:30.747369Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 470, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 3479, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 74394.34491703287, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824, "5": 4970.625541987829, "6": 7763.661833014339, "7": 19990.075874957256, "8": 19888.057208037935}, "receiver_prefill_ms": 352.1522500086576, "ttft_ms": 42.748916894197464, "decode_ms": 43.836083030328155}, "total_wall_ms": 74833.56412500143, "ttft_ms": 42.748916894197464, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | |
| 6353 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0bd0d9236e7e6858679ebca3", "attempt_id": "df60b3a28f0c", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:31.203193Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 471, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 3479, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 74394.34491703287, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824, "5": 4970.625541987829, "6": 7763.661833014339, "7": 19990.075874957256, "8": 19888.057208037935}, "receiver_prefill_ms": 348.0954170227051, "ttft_ms": 43.39912498835474, "decode_ms": 45.071667060256004}, "total_wall_ms": 74831.42375107855, "ttft_ms": 43.39912498835474, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | |
| 6354 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f90358cc02c8683295d680bb", "attempt_id": "78ca28800c77", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:31.656557Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 487, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 3479, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 74394.34491703287, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824, "5": 4970.625541987829, "6": 7763.661833014339, "7": 19990.075874957256, "8": 19888.057208037935}, "receiver_prefill_ms": 343.14599994104356, "ttft_ms": 43.34687499795109, "decode_ms": 44.94879103731364}, "total_wall_ms": 74826.35062502231, "ttft_ms": 43.34687499795109, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6355 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "cc9ce330ccf4853dfb3dcb38", "attempt_id": "f825c6f6578c", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:32.105447Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 478, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 3479, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 74394.34491703287, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824, "5": 4970.625541987829, "6": 7763.661833014339, "7": 19990.075874957256, "8": 19888.057208037935}, "receiver_prefill_ms": 345.6582920625806, "ttft_ms": 47.286625020205975, "decode_ms": 47.979500028304756}, "total_wall_ms": 74835.76629206073, "ttft_ms": 47.286625020205975, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6356 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a41acb50667e7f864294bac0", "attempt_id": "c11804a977a9", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:32.563433Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 486, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 3479, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 74394.34491703287, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824, "5": 4970.625541987829, "6": 7763.661833014339, "7": 19990.075874957256, "8": 19888.057208037935}, "receiver_prefill_ms": 349.50512496288866, "ttft_ms": 43.788625043816864, "decode_ms": 230.5075420299545}, "total_wall_ms": 75018.74208403751, "ttft_ms": 43.788625043816864, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Kovar-9", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "c969b5f7547945067f5b07e9f822d0043126326f979d950a8b1b045057fbb818"} | |
| 6357 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f41941a5d8bcebe43141d429", "attempt_id": "4628dc9ce16e", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:33.204580Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 482, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 3479, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 74394.34491703287, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824, "5": 4970.625541987829, "6": 7763.661833014339, "7": 19990.075874957256, "8": 19888.057208037935}, "receiver_prefill_ms": 322.29170901700854, "ttft_ms": 41.97966691572219, "decode_ms": 336.1370420316234}, "total_wall_ms": 75095.3966670204, "ttft_ms": 41.97966691572219, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "9484825", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "667b970507c4c6c7fb572757eb3b5eb04186ddb67a6ef680266b7a0924737993"} | |
| 6358 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7e420a79e238512cb1897a09", "attempt_id": "4dffb167c771", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:33.922899Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 477, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 3479, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 74394.34491703287, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824, "5": 4970.625541987829, "6": 7763.661833014339, "7": 19990.075874957256, "8": 19888.057208037935}, "receiver_prefill_ms": 334.5014579826966, "ttft_ms": 43.67445793468505, "decode_ms": 177.05166607629508}, "total_wall_ms": 74950.17541700508, "ttft_ms": 43.67445793468505, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "22.3", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "8afb0bb35e730fd32e7805d65081241bd21f43709df37165f4ec91c763f8a99d"} | |
| 6359 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "14202cc2f32a4176dd106b01", "attempt_id": "b035e5911950", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:34.496099Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 482, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 3479, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 74394.34491703287, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824, "5": 4970.625541987829, "6": 7763.661833014339, "7": 19990.075874957256, "8": 19888.057208037935}, "receiver_prefill_ms": 287.6303750090301, "ttft_ms": 50.758292083628476, "decode_ms": 45.91450002044439}, "total_wall_ms": 74779.32237612549, "ttft_ms": 50.758292083628476, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6360 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "fd33d63090bdafcef3f49ccf", "attempt_id": "eed2993c9598", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:34.898102Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 484, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 3479, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 74394.34491703287, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824, "5": 4970.625541987829, "6": 7763.661833014339, "7": 19990.075874957256, "8": 19888.057208037935}, "receiver_prefill_ms": 312.707083998248, "ttft_ms": 66.90520804841071, "decode_ms": 30.21133306901902}, "total_wall_ms": 74804.78116706945, "ttft_ms": 66.90520804841071, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6361 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "3f32aff76e950cc1f431ac0b", "attempt_id": "18e8a15f2269", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:57.689777Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 592, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22361.685457988642, "hops": {"1": 22361.685457988642}, "receiver_prefill_ms": 227.15991700533777, "ttft_ms": 11.977292015217245, "decode_ms": 12.12245796341449}, "total_wall_ms": 22613.57029201463, "ttft_ms": 11.977292015217245, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6362 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4ccce6a133688b4134eca730", "attempt_id": "69d1ebce5c5d", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:57.958203Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 598, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22361.685457988642, "hops": {"1": 22361.685457988642}, "receiver_prefill_ms": 227.10354207083583, "ttft_ms": 11.963792028836906, "decode_ms": 130.18362503498793}, "total_wall_ms": 22731.602748972364, "ttft_ms": 11.963792028836906, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 536-R, Senneterre", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "5e85af24aac0f1904d70a2fcee84f1b6f6912cc7450298af1f173002fd8e59df"} | |
| 6363 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "69fd52a6e9e971b5b0f1a5be", "attempt_id": "c3cd2d356187", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:58.344277Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 598, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22361.685457988642, "hops": {"1": 22361.685457988642}, "receiver_prefill_ms": 226.86120797879994, "ttft_ms": 12.056584004312754, "decode_ms": 83.35712493862957}, "total_wall_ms": 22684.603373985738, "ttft_ms": 12.056584004312754, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "88.7751", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "1e01e62c69f9479b681e50e59e8565c6583f5cdb803446a05ed5cb13118acdf9"} | |
| 6364 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "086a7f165c3fbc3ff0a9a94d", "attempt_id": "8fe5df06bc82", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:58.683917Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22361.685457988642, "hops": {"1": 22361.685457988642}, "receiver_prefill_ms": 226.997458958067, "ttft_ms": 11.92891609389335, "decode_ms": 47.57245793007314}, "total_wall_ms": 22648.729874985293, "ttft_ms": 11.92891609389335, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Ingrid Mbeki", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "1dbd85090bb65fb3b72de8ca4ce32f2c234729ff4a239274e79fb574b800a79d"} | |
| 6365 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "3b07f98b72002e5a2beb5675", "attempt_id": "480b6b5c4b68", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:58.987077Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 602, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22361.685457988642, "hops": {"1": 22361.685457988642}, "receiver_prefill_ms": 227.1020410116762, "ttft_ms": 11.852875002659857, "decode_ms": 11.78449997678399}, "total_wall_ms": 22612.94329096563, "ttft_ms": 11.852875002659857, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6366 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a70ed564ccfaa4f69e25a5db", "attempt_id": "180361820b0d", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:59.253998Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22361.685457988642, "hops": {"1": 22361.685457988642}, "receiver_prefill_ms": 227.24337503314018, "ttft_ms": 12.091082986444235, "decode_ms": 130.82462491001934}, "total_wall_ms": 22732.50016605016, "ttft_ms": 12.091082986444235, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "BQ-59Z-6753", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "db250f072c856fe7ddf4bbbd16e20c71b8bad1eef5e4480acd0dac30f8ffe9cd"} | |
| 6367 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "55ab9256a03c14bb7dd4931b", "attempt_id": "ef477ebc6624", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:59.640788Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 593, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22361.685457988642, "hops": {"1": 22361.685457988642}, "receiver_prefill_ms": 226.3879170641303, "ttft_ms": 12.00712495483458, "decode_ms": 11.904167011380196}, "total_wall_ms": 22612.498832982965, "ttft_ms": 12.00712495483458, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | |
| 6368 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7abf703b61fcd40e55e50017", "attempt_id": "8c998977055d", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:59.907437Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 594, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22361.685457988642, "hops": {"1": 22361.685457988642}, "receiver_prefill_ms": 226.28329205326736, "ttft_ms": 12.032249942421913, "decode_ms": 11.911874986253679}, "total_wall_ms": 22612.483248929493, "ttft_ms": 12.032249942421913, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "yes", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "8a798890fe93817163b10b5f7bd2ca4d25d84c52739a645a889c173eee7d9d3d"} | |
| 6369 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d65af73e32722271da5a697f", "attempt_id": "69e2265cd084", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:00.173848Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 610, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22361.685457988642, "hops": {"1": 22361.685457988642}, "receiver_prefill_ms": 228.54887507855892, "ttft_ms": 12.094540987163782, "decode_ms": 11.97579107247293}, "total_wall_ms": 22614.94124995079, "ttft_ms": 12.094540987163782, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6370 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "1b77b378869a751190db2006", "attempt_id": "dc6e82d8f82f", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:00.442933Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 601, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22361.685457988642, "hops": {"1": 22361.685457988642}, "receiver_prefill_ms": 226.77829093299806, "ttft_ms": 11.983916047029197, "decode_ms": 11.876125005073845}, "total_wall_ms": 22612.849042052403, "ttft_ms": 11.983916047029197, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6371 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e648daf57fc4b7499c862983", "attempt_id": "8933bb3596ed", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:00.709933Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 609, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22361.685457988642, "hops": {"1": 22361.685457988642}, "receiver_prefill_ms": 226.77929198835045, "ttft_ms": 11.996500077657402, "decode_ms": 59.55533299129456}, "total_wall_ms": 22660.552707966417, "ttft_ms": 11.996500077657402, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Kovar-9", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "c969b5f7547945067f5b07e9f822d0043126326f979d950a8b1b045057fbb818"} | |
| 6372 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "36038c95f552b868a77e602c", "attempt_id": "ed6f2fe9ce1e", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:01.024375Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 605, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22361.685457988642, "hops": {"1": 22361.685457988642}, "receiver_prefill_ms": 226.84737492818385, "ttft_ms": 11.92341698333621, "decode_ms": 83.45675002783537}, "total_wall_ms": 22684.485999983735, "ttft_ms": 11.92341698333621, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1302481", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "1c130ebf03e5051f031da47a49e8c91caae34e3c2144f451ec045a8e1c85549d"} | |
| 6373 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "492c0d6f11ac682eb4512d80", "attempt_id": "1fafdc280733", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:01.362678Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22361.685457988642, "hops": {"1": 22361.685457988642}, "receiver_prefill_ms": 227.03187505248934, "ttft_ms": 11.922708945348859, "decode_ms": 11.946249986067414}, "total_wall_ms": 22613.093541003764, "ttft_ms": 11.922708945348859, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6374 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "2df4dd884149fe98087de143", "attempt_id": "2afa5408fb88", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:01.630041Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 605, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22361.685457988642, "hops": {"1": 22361.685457988642}, "receiver_prefill_ms": 227.51516697462648, "ttft_ms": 12.134875054471195, "decode_ms": 11.938791954889894}, "total_wall_ms": 22613.76391700469, "ttft_ms": 12.134875054471195, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6375 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c686aa3b751a76688e4f0425", "attempt_id": "2f78f3dc67fc", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:01.897387Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 607, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22361.685457988642, "hops": {"1": 22361.685457988642}, "receiver_prefill_ms": 227.29337494820356, "ttft_ms": 12.00641703326255, "decode_ms": 11.979499948211014}, "total_wall_ms": 22613.481333013624, "ttft_ms": 12.00641703326255, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6376 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f862c2ccc6a03ef548071aab", "attempt_id": "045bce2d6652", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:07.294655Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 523, "message_tokens": 421, "message_utf8_bytes": 1181, "cache_tensor_bytes": null, "serialized_payload_bytes": 1181, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 27490.246208035387, "hops": {"1": 22361.685457988642, "2": 5128.560750046745}, "receiver_prefill_ms": 210.22116695530713, "ttft_ms": 11.660957941785455, "decode_ms": 11.498666950501502}, "total_wall_ms": 27724.15650007315, "ttft_ms": 11.660957941785455, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "8669fc537fe26ddfe1b74689f872379bdcad840ad09064ca93b4d5535b301a41", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6377 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "db12f48a9bbcdbd11e580978", "attempt_id": "4d033e5560f0", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:07.544880Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 529, "message_tokens": 421, "message_utf8_bytes": 1181, "cache_tensor_bytes": null, "serialized_payload_bytes": 1181, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 27490.246208035387, "hops": {"1": 22361.685457988642, "2": 5128.560750046745}, "receiver_prefill_ms": 209.99633392784745, "ttft_ms": 11.670165928080678, "decode_ms": 115.16645806841552}, "total_wall_ms": 27827.570000081323, "ttft_ms": 11.670165928080678, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 536-R, Senneterre.", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "8669fc537fe26ddfe1b74689f872379bdcad840ad09064ca93b4d5535b301a41", "output_hash": "d34fb8d4553d115f1c915ac9be75f68ef887916efddf5ed339f7cf4236ce8fa8"} | |
| 6378 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "20467eed2b5a943e1a5f0fa7", "attempt_id": "4d1c73b5afe8", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:07.898088Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 529, "message_tokens": 421, "message_utf8_bytes": 1181, "cache_tensor_bytes": null, "serialized_payload_bytes": 1181, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 27490.246208035387, "hops": {"1": 22361.685457988642, "2": 5128.560750046745}, "receiver_prefill_ms": 210.57508408557624, "ttft_ms": 11.598790995776653, "decode_ms": 45.95241602510214}, "total_wall_ms": 27758.832333027385, "ttft_ms": 11.598790995776653, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "88.7751", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "8669fc537fe26ddfe1b74689f872379bdcad840ad09064ca93b4d5535b301a41", "output_hash": "1e01e62c69f9479b681e50e59e8565c6583f5cdb803446a05ed5cb13118acdf9"} | |
| 6379 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "763d60481be4b5a97d68cdf6", "attempt_id": "9929b23e05b4", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:08.182280Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 526, "message_tokens": 421, "message_utf8_bytes": 1181, "cache_tensor_bytes": null, "serialized_payload_bytes": 1181, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 27490.246208035387, "hops": {"1": 22361.685457988642, "2": 5128.560750046745}, "receiver_prefill_ms": 210.09791700635105, "ttft_ms": 11.771790916100144, "decode_ms": 57.52425000537187}, "total_wall_ms": 27770.269833039492, "ttft_ms": 11.771790916100144, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Ingrid Mbeki.", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "8669fc537fe26ddfe1b74689f872379bdcad840ad09064ca93b4d5535b301a41", "output_hash": "4b9af6bc1085ca0df8d10d93274bfa44fbaf913b3380b2525ac5097c55375881"} | |
| 6380 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "03a50238aa5cbe37b7e41a6b", "attempt_id": "0db3937a6c23", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:08.477645Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 533, "message_tokens": 421, "message_utf8_bytes": 1181, "cache_tensor_bytes": null, "serialized_payload_bytes": 1181, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 27490.246208035387, "hops": {"1": 22361.685457988642, "2": 5128.560750046745}, "receiver_prefill_ms": 210.60975000727922, "ttft_ms": 11.655749985948205, "decode_ms": 11.569624999538064}, "total_wall_ms": 27724.703874089755, "ttft_ms": 11.655749985948205, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "8669fc537fe26ddfe1b74689f872379bdcad840ad09064ca93b4d5535b301a41", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6381 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "43c03f1b00667b18510f48ab", "attempt_id": "eb438b0eca2a", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:08.728978Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 532, "message_tokens": 421, "message_utf8_bytes": 1181, "cache_tensor_bytes": null, "serialized_payload_bytes": 1181, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 27490.246208035387, "hops": {"1": 22361.685457988642, "2": 5128.560750046745}, "receiver_prefill_ms": 210.614874958992, "ttft_ms": 11.602125014178455, "decode_ms": 92.22799993585795}, "total_wall_ms": 27805.317124002613, "ttft_ms": 11.602125014178455, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "BQ-59Z-6753", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "8669fc537fe26ddfe1b74689f872379bdcad840ad09064ca93b4d5535b301a41", "output_hash": "db250f072c856fe7ddf4bbbd16e20c71b8bad1eef5e4480acd0dac30f8ffe9cd"} | |
| 6382 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c675939ad6211efbb6373c30", "attempt_id": "92017bd50999", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:09.060414Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 524, "message_tokens": 421, "message_utf8_bytes": 1181, "cache_tensor_bytes": null, "serialized_payload_bytes": 1181, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 27490.246208035387, "hops": {"1": 22361.685457988642, "2": 5128.560750046745}, "receiver_prefill_ms": 209.64662497863173, "ttft_ms": 11.932790977880359, "decode_ms": 23.21420900989324}, "total_wall_ms": 27735.703124082647, "ttft_ms": 11.932790977880359, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "8669fc537fe26ddfe1b74689f872379bdcad840ad09064ca93b4d5535b301a41", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | |
| 6383 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "83fbc27fe5935e587845e2bb", "attempt_id": "72dfab763b07", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:09.321282Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 525, "message_tokens": 421, "message_utf8_bytes": 1181, "cache_tensor_bytes": null, "serialized_payload_bytes": 1181, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 27490.246208035387, "hops": {"1": 22361.685457988642, "2": 5128.560750046745}, "receiver_prefill_ms": 210.05875000264496, "ttft_ms": 11.809790972620249, "decode_ms": 23.053209064528346}, "total_wall_ms": 27735.625999979675, "ttft_ms": 11.809790972620249, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Yes.", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "8669fc537fe26ddfe1b74689f872379bdcad840ad09064ca93b4d5535b301a41", "output_hash": "5f9a2b795615ba6a3d5455fd5624d773fbca5bcd16249c421fd37411dc9837da"} | |
| 6384 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ad46b8a8e7e6aac75a20b736", "attempt_id": "67cbc96658cc", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:09.583398Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 541, "message_tokens": 421, "message_utf8_bytes": 1181, "cache_tensor_bytes": null, "serialized_payload_bytes": 1181, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 27490.246208035387, "hops": {"1": 22361.685457988642, "2": 5128.560750046745}, "receiver_prefill_ms": 210.89633298106492, "ttft_ms": 11.642707977443933, "decode_ms": 11.571875074878335}, "total_wall_ms": 27724.89658300765, "ttft_ms": 11.642707977443933, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "8669fc537fe26ddfe1b74689f872379bdcad840ad09064ca93b4d5535b301a41", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6385 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c05955bfb683065921a22812", "attempt_id": "1e21de775118", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:09.833444Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 532, "message_tokens": 421, "message_utf8_bytes": 1181, "cache_tensor_bytes": null, "serialized_payload_bytes": 1181, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 27490.246208035387, "hops": {"1": 22361.685457988642, "2": 5128.560750046745}, "receiver_prefill_ms": 210.49687499180436, "ttft_ms": 11.573707917705178, "decode_ms": 11.591500020585954}, "total_wall_ms": 27724.35154102277, "ttft_ms": 11.573707917705178, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "8669fc537fe26ddfe1b74689f872379bdcad840ad09064ca93b4d5535b301a41", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6386 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9b4347ff7944f073058090bf", "attempt_id": "be92416beb33", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:10.083222Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 540, "message_tokens": 421, "message_utf8_bytes": 1181, "cache_tensor_bytes": null, "serialized_payload_bytes": 1181, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 27490.246208035387, "hops": {"1": 22361.685457988642, "2": 5128.560750046745}, "receiver_prefill_ms": 210.98874998278916, "ttft_ms": 11.540542007423937, "decode_ms": 11.573166935704648}, "total_wall_ms": 27724.788957973942, "ttft_ms": 11.540542007423937, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "8669fc537fe26ddfe1b74689f872379bdcad840ad09064ca93b4d5535b301a41", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6387 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c3923e64928b533ab815197f", "attempt_id": "974a25d8a3b2", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:10.332740Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 536, "message_tokens": 421, "message_utf8_bytes": 1181, "cache_tensor_bytes": null, "serialized_payload_bytes": 1181, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 27490.246208035387, "hops": {"1": 22361.685457988642, "2": 5128.560750046745}, "receiver_prefill_ms": 210.7438329840079, "ttft_ms": 11.577583965845406, "decode_ms": 219.00204208213836}, "total_wall_ms": 27932.060915976763, "ttft_ms": 11.577583965845406, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 19}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4,862,425 + 5,646,720 = 10,509,145", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "8669fc537fe26ddfe1b74689f872379bdcad840ad09064ca93b4d5535b301a41", "output_hash": "038d9ed23c4639e6ae998b25ae021dada1e0ab0526113d0a0e4d8884ea4b4e6f"} | |
| 6388 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b8340747be15e7671266d69d", "attempt_id": "74b2ac82de5f", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:10.789438Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 531, "message_tokens": 421, "message_utf8_bytes": 1181, "cache_tensor_bytes": null, "serialized_payload_bytes": 1181, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 27490.246208035387, "hops": {"1": 22361.685457988642, "2": 5128.560750046745}, "receiver_prefill_ms": 210.57391597423702, "ttft_ms": 11.641624965704978, "decode_ms": 11.491750017739832}, "total_wall_ms": 27724.412208073772, "ttft_ms": 11.641624965704978, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "8669fc537fe26ddfe1b74689f872379bdcad840ad09064ca93b4d5535b301a41", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6389 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "54a7b3e6aea0779e89e63106", "attempt_id": "6291ce6a3a2a", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:11.038833Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 535, "message_tokens": 421, "message_utf8_bytes": 1181, "cache_tensor_bytes": null, "serialized_payload_bytes": 1181, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 27490.246208035387, "hops": {"1": 22361.685457988642, "2": 5128.560750046745}, "receiver_prefill_ms": 210.2422920288518, "ttft_ms": 11.586208012886345, "decode_ms": 11.50383404456079}, "total_wall_ms": 27724.0187501302, "ttft_ms": 11.586208012886345, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "8669fc537fe26ddfe1b74689f872379bdcad840ad09064ca93b4d5535b301a41", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6390 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "50a80ab68c959295f0b3f3d5", "attempt_id": "15b0346e5d8c", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:11.287613Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 538, "message_tokens": 421, "message_utf8_bytes": 1181, "cache_tensor_bytes": null, "serialized_payload_bytes": 1181, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 27490.246208035387, "hops": {"1": 22361.685457988642, "2": 5128.560750046745}, "receiver_prefill_ms": 210.84425004664809, "ttft_ms": 11.568416957743466, "decode_ms": 11.542583000846207}, "total_wall_ms": 27724.645416019484, "ttft_ms": 11.568416957743466, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "8669fc537fe26ddfe1b74689f872379bdcad840ad09064ca93b4d5535b301a41", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6391 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "8f8e838994a5174ead46b7d5", "attempt_id": "8cf5d1f0b1e4", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:21.918304Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 487, "message_tokens": 385, "message_utf8_bytes": 1111, "cache_tensor_bytes": null, "serialized_payload_bytes": 1111, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37869.45949902292, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536}, "receiver_prefill_ms": 207.54650002345443, "ttft_ms": 11.57233293633908, "decode_ms": 11.76929206121713}, "total_wall_ms": 38100.84308194928, "ttft_ms": 11.57233293633908, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1fb6b0e63657986ace0df6d3c1195f462c1359afc69ed5a7dad3ca3220aa6437", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6392 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "2db0d38245b2405e048a54e0", "attempt_id": "70b698c53a4f", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:22.166273Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 493, "message_tokens": 385, "message_utf8_bytes": 1111, "cache_tensor_bytes": null, "serialized_payload_bytes": 1111, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37869.45949902292, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536}, "receiver_prefill_ms": 209.6134580206126, "ttft_ms": 11.551541974768043, "decode_ms": 115.2444159379229}, "total_wall_ms": 38206.339915981516, "ttft_ms": 11.551541974768043, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 536-R, Senneterre.", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1fb6b0e63657986ace0df6d3c1195f462c1359afc69ed5a7dad3ca3220aa6437", "output_hash": "d34fb8d4553d115f1c915ac9be75f68ef887916efddf5ed339f7cf4236ce8fa8"} | |
| 6393 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c274063c0b31713f29296ab0", "attempt_id": "ff432b7730f3", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:22.518638Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 493, "message_tokens": 385, "message_utf8_bytes": 1111, "cache_tensor_bytes": null, "serialized_payload_bytes": 1111, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37869.45949902292, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536}, "receiver_prefill_ms": 206.88049995806068, "ttft_ms": 11.547166970558465, "decode_ms": 45.98920908756554}, "total_wall_ms": 38134.30274894927, "ttft_ms": 11.547166970558465, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "88.7751", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1fb6b0e63657986ace0df6d3c1195f462c1359afc69ed5a7dad3ca3220aa6437", "output_hash": "1e01e62c69f9479b681e50e59e8565c6583f5cdb803446a05ed5cb13118acdf9"} | |
| 6394 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "08abe6ac6fa2a1af4a65fef3", "attempt_id": "5d5f05aef9e0", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:22.798662Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 490, "message_tokens": 385, "message_utf8_bytes": 1111, "cache_tensor_bytes": null, "serialized_payload_bytes": 1111, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37869.45949902292, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536}, "receiver_prefill_ms": 205.76804096344858, "ttft_ms": 11.562332976609468, "decode_ms": 45.92741699889302}, "total_wall_ms": 38133.16487404518, "ttft_ms": 11.562332976609468, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Ingrid Mbeki", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1fb6b0e63657986ace0df6d3c1195f462c1359afc69ed5a7dad3ca3220aa6437", "output_hash": "1dbd85090bb65fb3b72de8ca4ce32f2c234729ff4a239274e79fb574b800a79d"} | |
| 6395 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "79e4060b1f6f6b4884b63681", "attempt_id": "172508a55104", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:23.077990Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 497, "message_tokens": 385, "message_utf8_bytes": 1111, "cache_tensor_bytes": null, "serialized_payload_bytes": 1111, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37869.45949902292, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536}, "receiver_prefill_ms": 208.45854096114635, "ttft_ms": 11.590208043344319, "decode_ms": 11.560541926883161}, "total_wall_ms": 38101.5318329446, "ttft_ms": 11.590208043344319, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1fb6b0e63657986ace0df6d3c1195f462c1359afc69ed5a7dad3ca3220aa6437", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6396 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a562deb1d153141db63bc3ae", "attempt_id": "c81fbe85b986", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:23.325117Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 496, "message_tokens": 385, "message_utf8_bytes": 1111, "cache_tensor_bytes": null, "serialized_payload_bytes": 1111, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37869.45949902292, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536}, "receiver_prefill_ms": 207.76049990672618, "ttft_ms": 11.609584093093872, "decode_ms": 91.86570800375193}, "total_wall_ms": 38181.12691491842, "ttft_ms": 11.609584093093872, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "BQ-59Z-6753", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1fb6b0e63657986ace0df6d3c1195f462c1359afc69ed5a7dad3ca3220aa6437", "output_hash": "db250f072c856fe7ddf4bbbd16e20c71b8bad1eef5e4480acd0dac30f8ffe9cd"} | |
| 6397 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "3fbff6745fe8870007f76375", "attempt_id": "a444b81acc61", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:23.652075Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 488, "message_tokens": 385, "message_utf8_bytes": 1111, "cache_tensor_bytes": null, "serialized_payload_bytes": 1111, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37869.45949902292, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536}, "receiver_prefill_ms": 205.86283307056874, "ttft_ms": 11.583667015656829, "decode_ms": 23.060834035277367}, "total_wall_ms": 38110.413582995534, "ttft_ms": 11.583667015656829, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1fb6b0e63657986ace0df6d3c1195f462c1359afc69ed5a7dad3ca3220aa6437", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | |
| 6398 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4e3cec7c9b0ec4868d6642da", "attempt_id": "2f59ef09a633", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:23.908264Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 489, "message_tokens": 385, "message_utf8_bytes": 1111, "cache_tensor_bytes": null, "serialized_payload_bytes": 1111, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37869.45949902292, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536}, "receiver_prefill_ms": 204.29266605060548, "ttft_ms": 11.598250013776124, "decode_ms": 23.074583965353668}, "total_wall_ms": 38108.83570695296, "ttft_ms": 11.598250013776124, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Yes.", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1fb6b0e63657986ace0df6d3c1195f462c1359afc69ed5a7dad3ca3220aa6437", "output_hash": "5f9a2b795615ba6a3d5455fd5624d773fbca5bcd16249c421fd37411dc9837da"} | |
| 6399 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "3d866a4a0d91dc939570e711", "attempt_id": "186e9400ec55", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:24.162872Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 505, "message_tokens": 385, "message_utf8_bytes": 1111, "cache_tensor_bytes": null, "serialized_payload_bytes": 1111, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37869.45949902292, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536}, "receiver_prefill_ms": 207.75370893534273, "ttft_ms": 11.625792016275227, "decode_ms": 11.582374921999872}, "total_wall_ms": 38100.87904101238, "ttft_ms": 11.625792016275227, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1fb6b0e63657986ace0df6d3c1195f462c1359afc69ed5a7dad3ca3220aa6437", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6400 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "cc7b085d691e3ff4e3a0e760", "attempt_id": "757bc48ff199", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:24.409225Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 496, "message_tokens": 385, "message_utf8_bytes": 1111, "cache_tensor_bytes": null, "serialized_payload_bytes": 1111, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37869.45949902292, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536}, "receiver_prefill_ms": 203.9944170974195, "ttft_ms": 11.524083907715976, "decode_ms": 11.50795805733651}, "total_wall_ms": 38096.91137401387, "ttft_ms": 11.524083907715976, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1fb6b0e63657986ace0df6d3c1195f462c1359afc69ed5a7dad3ca3220aa6437", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6401 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "1b2c19d6fc08f28efbe8c682", "attempt_id": "f4f7ab28d7a2", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:24.652131Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 504, "message_tokens": 385, "message_utf8_bytes": 1111, "cache_tensor_bytes": null, "serialized_payload_bytes": 1111, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37869.45949902292, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536}, "receiver_prefill_ms": 206.81166602298617, "ttft_ms": 11.575083015486598, "decode_ms": 11.601999984122813}, "total_wall_ms": 38099.86699896399, "ttft_ms": 11.575083015486598, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1fb6b0e63657986ace0df6d3c1195f462c1359afc69ed5a7dad3ca3220aa6437", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6402 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "3a1f23850d4f95f7b6b6870c", "attempt_id": "99402b636d75", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:24.897630Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 500, "message_tokens": 385, "message_utf8_bytes": 1111, "cache_tensor_bytes": null, "serialized_payload_bytes": 1111, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37869.45949902292, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536}, "receiver_prefill_ms": 206.85012498870492, "ttft_ms": 11.604624916799366, "decode_ms": 219.0847919555381}, "total_wall_ms": 38307.52749904059, "ttft_ms": 11.604624916799366, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 19}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4,862,425 + 5,646,720 = 10,509,145", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1fb6b0e63657986ace0df6d3c1195f462c1359afc69ed5a7dad3ca3220aa6437", "output_hash": "038d9ed23c4639e6ae998b25ae021dada1e0ab0526113d0a0e4d8884ea4b4e6f"} | |
| 6403 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "87302980abc81826c43804e4", "attempt_id": "e37a2124be1c", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:25.350792Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 495, "message_tokens": 385, "message_utf8_bytes": 1111, "cache_tensor_bytes": null, "serialized_payload_bytes": 1111, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37869.45949902292, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536}, "receiver_prefill_ms": 207.85816700663418, "ttft_ms": 11.542499996721745, "decode_ms": 11.541875079274178}, "total_wall_ms": 38100.84054002073, "ttft_ms": 11.542499996721745, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1fb6b0e63657986ace0df6d3c1195f462c1359afc69ed5a7dad3ca3220aa6437", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6404 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9d9fda703c1bf5aac43ed159", "attempt_id": "dda852f30875", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:25.597921Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 499, "message_tokens": 385, "message_utf8_bytes": 1111, "cache_tensor_bytes": null, "serialized_payload_bytes": 1111, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37869.45949902292, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536}, "receiver_prefill_ms": 206.54475002083927, "ttft_ms": 11.62362506147474, "decode_ms": 11.549124959856272}, "total_wall_ms": 38099.6261240216, "ttft_ms": 11.62362506147474, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1fb6b0e63657986ace0df6d3c1195f462c1359afc69ed5a7dad3ca3220aa6437", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6405 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "2098f6b968e839a34bf81661", "attempt_id": "5f675f70215c", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:25.843454Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 502, "message_tokens": 385, "message_utf8_bytes": 1111, "cache_tensor_bytes": null, "serialized_payload_bytes": 1111, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37869.45949902292, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536}, "receiver_prefill_ms": 207.72512489929795, "ttft_ms": 11.560374987311661, "decode_ms": 11.518125073052943}, "total_wall_ms": 38100.68291600328, "ttft_ms": 11.560374987311661, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1fb6b0e63657986ace0df6d3c1195f462c1359afc69ed5a7dad3ca3220aa6437", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6406 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "47b0c435f5590667052b70cc", "attempt_id": "9f605633dd38", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:47.377868Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 496, "message_tokens": 394, "message_utf8_bytes": 1153, "cache_tensor_bytes": null, "serialized_payload_bytes": 1153, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 59152.118457946926, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536, "5": 5842.431625002064, "6": 4801.743416930549, "7": 5841.1449999548495, "8": 4797.338917036541}, "receiver_prefill_ms": 205.95662505365908, "ttft_ms": 11.59316604025662, "decode_ms": 11.459583067335188}, "total_wall_ms": 59381.6127498867, "ttft_ms": 11.59316604025662, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "5": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "6": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "7": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "8": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1d0e469668b88ffe7676989aa63ff9a7d27eb7c55484b06c14ba4e2a98a13623", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6407 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "99a3d543aa37f01f328ea23a", "attempt_id": "9ab8015c9dc0", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:47.623528Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 502, "message_tokens": 394, "message_utf8_bytes": 1153, "cache_tensor_bytes": null, "serialized_payload_bytes": 1153, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 59152.118457946926, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536, "5": 5842.431625002064, "6": 4801.743416930549, "7": 5841.1449999548495, "8": 4797.338917036541}, "receiver_prefill_ms": 206.6960830707103, "ttft_ms": 11.563332984223962, "decode_ms": 114.8346250411123}, "total_wall_ms": 59485.684790997766, "ttft_ms": 11.563332984223962, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 536-R, Senneterre.", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "5": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "6": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "7": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "8": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1d0e469668b88ffe7676989aa63ff9a7d27eb7c55484b06c14ba4e2a98a13623", "output_hash": "d34fb8d4553d115f1c915ac9be75f68ef887916efddf5ed339f7cf4236ce8fa8"} | |
| 6408 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "89a65bba6e1b336011f8aec9", "attempt_id": "20a4b51c9156", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:47.972924Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 502, "message_tokens": 394, "message_utf8_bytes": 1153, "cache_tensor_bytes": null, "serialized_payload_bytes": 1153, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 59152.118457946926, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536, "5": 5842.431625002064, "6": 4801.743416930549, "7": 5841.1449999548495, "8": 4797.338917036541}, "receiver_prefill_ms": 206.66645804885775, "ttft_ms": 11.547207948751748, "decode_ms": 46.02350003551692}, "total_wall_ms": 59416.78358300123, "ttft_ms": 11.547207948751748, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "88.7751", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "5": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "6": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "7": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "8": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1d0e469668b88ffe7676989aa63ff9a7d27eb7c55484b06c14ba4e2a98a13623", "output_hash": "1e01e62c69f9479b681e50e59e8565c6583f5cdb803446a05ed5cb13118acdf9"} | |
| 6409 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b00612f22399e784b78945b2", "attempt_id": "01cbb4d53e4c", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:48.253248Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 499, "message_tokens": 394, "message_utf8_bytes": 1153, "cache_tensor_bytes": null, "serialized_payload_bytes": 1153, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 59152.118457946926, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536, "5": 5842.431625002064, "6": 4801.743416930549, "7": 5841.1449999548495, "8": 4797.338917036541}, "receiver_prefill_ms": 210.11308289598674, "ttft_ms": 11.517458013258874, "decode_ms": 45.92083301395178}, "total_wall_ms": 59420.10579095222, "ttft_ms": 11.517458013258874, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Ingrid Mbeki", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "5": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "6": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "7": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "8": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1d0e469668b88ffe7676989aa63ff9a7d27eb7c55484b06c14ba4e2a98a13623", "output_hash": "1dbd85090bb65fb3b72de8ca4ce32f2c234729ff4a239274e79fb574b800a79d"} | |
| 6410 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0b66a30ba67b1da9ef5ac9a7", "attempt_id": "b74ae4e23191", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:48.536596Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 506, "message_tokens": 394, "message_utf8_bytes": 1153, "cache_tensor_bytes": null, "serialized_payload_bytes": 1153, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 59152.118457946926, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536, "5": 5842.431625002064, "6": 4801.743416930549, "7": 5841.1449999548495, "8": 4797.338917036541}, "receiver_prefill_ms": 208.13258294947445, "ttft_ms": 11.538416962139308, "decode_ms": 11.483917012810707}, "total_wall_ms": 59383.72379099019, "ttft_ms": 11.538416962139308, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "5": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "6": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "7": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "8": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1d0e469668b88ffe7676989aa63ff9a7d27eb7c55484b06c14ba4e2a98a13623", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6411 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d81a69863438829b555f8f8f", "attempt_id": "f13f602f2686", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:48.783277Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 505, "message_tokens": 394, "message_utf8_bytes": 1153, "cache_tensor_bytes": null, "serialized_payload_bytes": 1153, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 59152.118457946926, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536, "5": 5842.431625002064, "6": 4801.743416930549, "7": 5841.1449999548495, "8": 4797.338917036541}, "receiver_prefill_ms": 206.34704106487334, "ttft_ms": 11.641249991953373, "decode_ms": 92.6754999672994}, "total_wall_ms": 59463.234957889654, "ttft_ms": 11.641249991953373, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "BQ-59Z-6753", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "5": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "6": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "7": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "8": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1d0e469668b88ffe7676989aa63ff9a7d27eb7c55484b06c14ba4e2a98a13623", "output_hash": "db250f072c856fe7ddf4bbbd16e20c71b8bad1eef5e4480acd0dac30f8ffe9cd"} | |
| 6412 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "bce7b4e9487dea641eff9f6b", "attempt_id": "70b01a767e43", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:49.109760Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 497, "message_tokens": 394, "message_utf8_bytes": 1153, "cache_tensor_bytes": null, "serialized_payload_bytes": 1153, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 59152.118457946926, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536, "5": 5842.431625002064, "6": 4801.743416930549, "7": 5841.1449999548495, "8": 4797.338917036541}, "receiver_prefill_ms": 207.62108301278204, "ttft_ms": 11.487792013213038, "decode_ms": 22.975333034992218}, "total_wall_ms": 59394.65216593817, "ttft_ms": 11.487792013213038, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "5": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "6": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "7": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "8": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1d0e469668b88ffe7676989aa63ff9a7d27eb7c55484b06c14ba4e2a98a13623", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | |
| 6413 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "11f6ab043bd0d6445d4a22fc", "attempt_id": "e1d62530d976", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:49.367570Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 498, "message_tokens": 394, "message_utf8_bytes": 1153, "cache_tensor_bytes": null, "serialized_payload_bytes": 1153, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 59152.118457946926, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536, "5": 5842.431625002064, "6": 4801.743416930549, "7": 5841.1449999548495, "8": 4797.338917036541}, "receiver_prefill_ms": 206.44120790529996, "ttft_ms": 11.569041991606355, "decode_ms": 23.052542004734278}, "total_wall_ms": 59393.60666600987, "ttft_ms": 11.569041991606355, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Yes.", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "5": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "6": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "7": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "8": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1d0e469668b88ffe7676989aa63ff9a7d27eb7c55484b06c14ba4e2a98a13623", "output_hash": "5f9a2b795615ba6a3d5455fd5624d773fbca5bcd16249c421fd37411dc9837da"} | |
| 6414 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4e69b55d29e1ef6ce3f95370", "attempt_id": "91ed5581f304", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:49.624050Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 514, "message_tokens": 394, "message_utf8_bytes": 1153, "cache_tensor_bytes": null, "serialized_payload_bytes": 1153, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 59152.118457946926, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536, "5": 5842.431625002064, "6": 4801.743416930549, "7": 5841.1449999548495, "8": 4797.338917036541}, "receiver_prefill_ms": 209.82333295978606, "ttft_ms": 11.583083076402545, "decode_ms": 11.585792060941458}, "total_wall_ms": 59385.55579201784, "ttft_ms": 11.583083076402545, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "5": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "6": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "7": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "8": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1d0e469668b88ffe7676989aa63ff9a7d27eb7c55484b06c14ba4e2a98a13623", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6415 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "db2e2ca503c3437617be4518", "attempt_id": "2e08cbf2b593", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:49.872062Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 505, "message_tokens": 394, "message_utf8_bytes": 1153, "cache_tensor_bytes": null, "serialized_payload_bytes": 1153, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 59152.118457946926, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536, "5": 5842.431625002064, "6": 4801.743416930549, "7": 5841.1449999548495, "8": 4797.338917036541}, "receiver_prefill_ms": 207.5721659930423, "ttft_ms": 11.556250043213367, "decode_ms": 11.70158397872001}, "total_wall_ms": 59383.36149987299, "ttft_ms": 11.556250043213367, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "5": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "6": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "7": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "8": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1d0e469668b88ffe7676989aa63ff9a7d27eb7c55484b06c14ba4e2a98a13623", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6416 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "554d52fa0c367eb1ec9d15aa", "attempt_id": "5324c66f387a", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:50.118455Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 513, "message_tokens": 394, "message_utf8_bytes": 1153, "cache_tensor_bytes": null, "serialized_payload_bytes": 1153, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 59152.118457946926, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536, "5": 5842.431625002064, "6": 4801.743416930549, "7": 5841.1449999548495, "8": 4797.338917036541}, "receiver_prefill_ms": 201.75858295988292, "ttft_ms": 12.069458025507629, "decode_ms": 11.520624975673854}, "total_wall_ms": 59377.917541889474, "ttft_ms": 12.069458025507629, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "5": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "6": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "7": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "8": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1d0e469668b88ffe7676989aa63ff9a7d27eb7c55484b06c14ba4e2a98a13623", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6417 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "316c03a73ff4f029fa238073", "attempt_id": "ada79664ec3a", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:50.359256Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 509, "message_tokens": 394, "message_utf8_bytes": 1153, "cache_tensor_bytes": null, "serialized_payload_bytes": 1153, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 59152.118457946926, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536, "5": 5842.431625002064, "6": 4801.743416930549, "7": 5841.1449999548495, "8": 4797.338917036541}, "receiver_prefill_ms": 209.5855000661686, "ttft_ms": 11.568957939743996, "decode_ms": 57.92950000613928}, "total_wall_ms": 59431.65408296045, "ttft_ms": 11.568957939743996, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,462,111", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "5": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "6": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "7": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "8": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1d0e469668b88ffe7676989aa63ff9a7d27eb7c55484b06c14ba4e2a98a13623", "output_hash": "1e8c5e2011479311a255cce5a1f78bfee345f6bb870c300bc4a818f9676ae0f7"} | |
| 6418 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "daec267862fd7be55147e162", "attempt_id": "4eb8785ee3ae", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:50.653864Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 504, "message_tokens": 394, "message_utf8_bytes": 1153, "cache_tensor_bytes": null, "serialized_payload_bytes": 1153, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 59152.118457946926, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536, "5": 5842.431625002064, "6": 4801.743416930549, "7": 5841.1449999548495, "8": 4797.338917036541}, "receiver_prefill_ms": 207.30849995743483, "ttft_ms": 11.553292046301067, "decode_ms": 11.53462496586144}, "total_wall_ms": 59382.938416907564, "ttft_ms": 11.553292046301067, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "5": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "6": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "7": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "8": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1d0e469668b88ffe7676989aa63ff9a7d27eb7c55484b06c14ba4e2a98a13623", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6419 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "16ee8ff78db3d832aa9646c6", "attempt_id": "f12a737cf5bc", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:50.899998Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 508, "message_tokens": 394, "message_utf8_bytes": 1153, "cache_tensor_bytes": null, "serialized_payload_bytes": 1153, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 59152.118457946926, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536, "5": 5842.431625002064, "6": 4801.743416930549, "7": 5841.1449999548495, "8": 4797.338917036541}, "receiver_prefill_ms": 208.131332998164, "ttft_ms": 11.484291986562312, "decode_ms": 11.48550002835691}, "total_wall_ms": 59383.632665965706, "ttft_ms": 11.484291986562312, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "5": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "6": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "7": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "8": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1d0e469668b88ffe7676989aa63ff9a7d27eb7c55484b06c14ba4e2a98a13623", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6420 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "403a324c3a443931c24c3464", "attempt_id": "667c30b3b48f", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:51.146374Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 511, "message_tokens": 394, "message_utf8_bytes": 1153, "cache_tensor_bytes": null, "serialized_payload_bytes": 1153, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 59152.118457946926, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536, "5": 5842.431625002064, "6": 4801.743416930549, "7": 5841.1449999548495, "8": 4797.338917036541}, "receiver_prefill_ms": 209.0514999581501, "ttft_ms": 11.6252499865368, "decode_ms": 11.530208983458579}, "total_wall_ms": 59384.7572079394, "ttft_ms": 11.6252499865368, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "5": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "6": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "7": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "8": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1d0e469668b88ffe7676989aa63ff9a7d27eb7c55484b06c14ba4e2a98a13623", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6421 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d94bd2b391c9476d7942e1a9", "attempt_id": "d24b59948acb", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:58.292749Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 460, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.219208021648, "hops": {"1": 6896.219208021648}, "receiver_prefill_ms": 185.3049589553848, "ttft_ms": 11.899915989488363, "decode_ms": 11.902792030014098}, "total_wall_ms": 7105.795498937368, "ttft_ms": 11.899915989488363, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6422 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c627238105d4610f85562eb6", "attempt_id": "a5f5dcd96290", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:58.519084Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 466, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.219208021648, "hops": {"1": 6896.219208021648}, "receiver_prefill_ms": 185.94200001098216, "ttft_ms": 11.91279198974371, "decode_ms": 11.917916941456497}, "total_wall_ms": 7106.413958012126, "ttft_ms": 11.91279198974371, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6423 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ad23cd890228829d4da8d7a1", "attempt_id": "68906bce5b5d", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:58.744947Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 466, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.219208021648, "hops": {"1": 6896.219208021648}, "receiver_prefill_ms": 185.74570794589818, "ttft_ms": 11.916583054699004, "decode_ms": 11.870707967318594}, "total_wall_ms": 7106.15970811341, "ttft_ms": 11.916583054699004, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6424 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "298ded8dadbaead1a4fe8379", "attempt_id": "e90500f4de7f", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:58.970603Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 463, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.219208021648, "hops": {"1": 6896.219208021648}, "receiver_prefill_ms": 185.68716698791832, "ttft_ms": 11.910875095054507, "decode_ms": 11.900958023034036}, "total_wall_ms": 7106.149208033457, "ttft_ms": 11.910875095054507, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6425 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "fdb95e87f6532bec0e8ea726", "attempt_id": "161443b5114e", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:59.196006Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 470, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.219208021648, "hops": {"1": 6896.219208021648}, "receiver_prefill_ms": 186.10466609243304, "ttft_ms": 11.861750041134655, "decode_ms": 11.738874949514866}, "total_wall_ms": 7106.345208012499, "ttft_ms": 11.861750041134655, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6426 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4691649577f490c260a5e72b", "attempt_id": "590d592a7558", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:59.421712Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 471, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.219208021648, "hops": {"1": 6896.219208021648}, "receiver_prefill_ms": 186.07658299151808, "ttft_ms": 11.910666013136506, "decode_ms": 118.41008299961686}, "total_wall_ms": 7213.05958298035, "ttft_ms": 11.910666013136506, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "MH-96F-2099", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "95c230d14a055d30e0e1d4355caf07808e1c968b1feab9e0607d8bd37b1b43dc"} | |
| 6427 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "21efce31b54db81fd2083aa9", "attempt_id": "9d1eaba4b5f2", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:59.755399Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 461, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.219208021648, "hops": {"1": 6896.219208021648}, "receiver_prefill_ms": 185.44695805758238, "ttft_ms": 11.878374963998795, "decode_ms": 11.877959012053907}, "total_wall_ms": 7105.824374011718, "ttft_ms": 11.878374963998795, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | |
| 6428 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "70651103e2d6240d7d54aa63", "attempt_id": "beaf88b29f38", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:59.980738Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 462, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.219208021648, "hops": {"1": 6896.219208021648}, "receiver_prefill_ms": 185.67370797973126, "ttft_ms": 11.92712492775172, "decode_ms": 11.881958926096559}, "total_wall_ms": 7106.162457959726, "ttft_ms": 11.92712492775172, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | |
| 6429 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "6bac3956a13836af56a96c9f", "attempt_id": "ec25bf611281", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:00.205976Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 478, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.219208021648, "hops": {"1": 6896.219208021648}, "receiver_prefill_ms": 186.0346250468865, "ttft_ms": 11.902834055945277, "decode_ms": 11.930583976209164}, "total_wall_ms": 7106.514499988407, "ttft_ms": 11.902834055945277, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6430 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ec08c98c3933b9421a97c0dd", "attempt_id": "3688ec5e64f1", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:00.432038Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 469, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.219208021648, "hops": {"1": 6896.219208021648}, "receiver_prefill_ms": 185.93170901294798, "ttft_ms": 11.897167074494064, "decode_ms": 82.97449990641326}, "total_wall_ms": 7177.434250130318, "ttft_ms": 11.897167074494064, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5646720", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "e1d129e860627cf4623671ed186cb4ebbf5d63169d3d0dc14a62e1da2af61326"} | |
| 6431 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "99ead5cb42605d885af16045", "attempt_id": "6006dfe167ac", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:00.728630Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 477, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.219208021648, "hops": {"1": 6896.219208021648}, "receiver_prefill_ms": 186.8581249145791, "ttft_ms": 12.082583038136363, "decode_ms": 59.241166920401156}, "total_wall_ms": 7154.818832990713, "ttft_ms": 12.082583038136363, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Kovar-9", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "c969b5f7547945067f5b07e9f822d0043126326f979d950a8b1b045057fbb818"} | |
| 6432 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5e2d348c636307add8dd93fa", "attempt_id": "95599e5221b8", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:01.002997Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 473, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.219208021648, "hops": {"1": 6896.219208021648}, "receiver_prefill_ms": 186.658582999371, "ttft_ms": 11.848250054754317, "decode_ms": 83.23183306492865}, "total_wall_ms": 7178.38500009384, "ttft_ms": 11.848250054754317, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "9484825", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "667b970507c4c6c7fb572757eb3b5eb04186ddb67a6ef680266b7a0924737993"} | |
| 6433 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4cc7f5f99bcd42d25d3b32c8", "attempt_id": "db0b1823d1af", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:01.300606Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 468, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.219208021648, "hops": {"1": 6896.219208021648}, "receiver_prefill_ms": 185.568124987185, "ttft_ms": 11.901542078703642, "decode_ms": 47.460832982324064}, "total_wall_ms": 7141.546333092265, "ttft_ms": 11.901542078703642, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "22.3", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "8afb0bb35e730fd32e7805d65081241bd21f43709df37165f4ec91c763f8a99d"} | |
| 6434 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "bd0dda3d16fc4715cfe7cd86", "attempt_id": "d57050504468", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:01.561261Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 473, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.219208021648, "hops": {"1": 6896.219208021648}, "receiver_prefill_ms": 185.87141600437462, "ttft_ms": 11.87141693662852, "decode_ms": 11.888000066392124}, "total_wall_ms": 7106.263792025857, "ttft_ms": 11.87141693662852, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6435 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b6fb0cc24c8692d1e1421e0c", "attempt_id": "2263ec42fefc", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:01.786559Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 475, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.219208021648, "hops": {"1": 6896.219208021648}, "receiver_prefill_ms": 185.947582940571, "ttft_ms": 12.029374949634075, "decode_ms": 11.90191600471735}, "total_wall_ms": 7106.496624997817, "ttft_ms": 12.029374949634075, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6436 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7ee5cdf80b64d488a3b00110", "attempt_id": "0eb57dbca981", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:06.307676Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 452, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11190.593583043665, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165}, "receiver_prefill_ms": 200.07650007028133, "ttft_ms": 11.643542093224823, "decode_ms": 11.542499996721745}, "total_wall_ms": 11414.357333094813, "ttft_ms": 11.643542093224823, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6437 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4519603f860f348a0a6c6b2d", "attempt_id": "ebd3a9b74a86", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:06.547993Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 458, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11190.593583043665, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165}, "receiver_prefill_ms": 202.44499994441867, "ttft_ms": 11.635957984253764, "decode_ms": 11.510084033943713}, "total_wall_ms": 11416.62091598846, "ttft_ms": 11.635957984253764, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6438 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0210c299a673a58a8657a332", "attempt_id": "f57bb37548a9", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:06.790192Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 458, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11190.593583043665, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165}, "receiver_prefill_ms": 202.78220798354596, "ttft_ms": 11.736541986465454, "decode_ms": 11.570625007152557}, "total_wall_ms": 11417.214958113618, "ttft_ms": 11.736541986465454, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6439 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c81f41666a0553f5a57da6eb", "attempt_id": "d81a7cc6762e", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:07.032580Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 455, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11190.593583043665, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165}, "receiver_prefill_ms": 201.61716593429446, "ttft_ms": 11.642958037555218, "decode_ms": 11.505665956065059}, "total_wall_ms": 11415.777583024465, "ttft_ms": 11.642958037555218, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6440 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ff5dbe3458154d43b364f052", "attempt_id": "b993906eee4b", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:07.273243Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 462, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11190.593583043665, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165}, "receiver_prefill_ms": 203.95933301188052, "ttft_ms": 11.543333996087313, "decode_ms": 11.669458006508648}, "total_wall_ms": 11418.174999998882, "ttft_ms": 11.543333996087313, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6441 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "28281e6eec70eee2481a6751", "attempt_id": "5d4bd0a99718", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:07.516176Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 461, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11190.593583043665, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165}, "receiver_prefill_ms": 203.4829999320209, "ttft_ms": 11.53916702605784, "decode_ms": 11.539792059920728}, "total_wall_ms": 11417.54320799373, "ttft_ms": 11.53916702605784, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6442 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "cc418b36d9accce7b295a3e3", "attempt_id": "c706385040be", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:07.758247Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 453, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11190.593583043665, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165}, "receiver_prefill_ms": 202.41237501613796, "ttft_ms": 11.804334004409611, "decode_ms": 23.27070792671293}, "total_wall_ms": 11428.596249083057, "ttft_ms": 11.804334004409611, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | |
| 6443 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "03dab83f7c9088cb70f1f04f", "attempt_id": "8074c2d95dc9", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:08.011637Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 454, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11190.593583043665, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165}, "receiver_prefill_ms": 199.69187502283603, "ttft_ms": 11.559708043932915, "decode_ms": 11.51358406059444}, "total_wall_ms": 11413.757000002079, "ttft_ms": 11.559708043932915, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | |
| 6444 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "fbd28c25e407a34fa567bdb9", "attempt_id": "a6f8fc675d36", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:08.250525Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 470, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11190.593583043665, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165}, "receiver_prefill_ms": 204.81916691642255, "ttft_ms": 11.57983299344778, "decode_ms": 11.55637507326901}, "total_wall_ms": 11418.969124089926, "ttft_ms": 11.57983299344778, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6445 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "3367c76ca1ea311009197e69", "attempt_id": "4a9a55e26ed9", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:08.494368Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 461, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11190.593583043665, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165}, "receiver_prefill_ms": 203.2025830121711, "ttft_ms": 11.617250042036176, "decode_ms": 11.478040949441493}, "total_wall_ms": 11417.28666704148, "ttft_ms": 11.617250042036176, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6446 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d07793136fa65ff0a9ef5424", "attempt_id": "3dd7673edfd8", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:08.736237Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 469, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11190.593583043665, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165}, "receiver_prefill_ms": 203.61879095435143, "ttft_ms": 11.561291990801692, "decode_ms": 11.525708017870784}, "total_wall_ms": 11417.696125106886, "ttft_ms": 11.561291990801692, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6447 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "310b3a162b944435e740c295", "attempt_id": "b2e905b5590e", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:08.978325Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 465, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11190.593583043665, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165}, "receiver_prefill_ms": 202.004500082694, "ttft_ms": 11.60787499975413, "decode_ms": 57.55241704173386}, "total_wall_ms": 11462.183666066267, "ttft_ms": 11.60787499975413, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5,646,720", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "2c0bb14ad8ba61e6d23fb3dea5205f2f02c43c95a0cf8e7f93c240ddea626ad4"} | |
| 6448 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "cc7d9218e620071898a4957b", "attempt_id": "4131ea95c074", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:09.264754Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 460, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11190.593583043665, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165}, "receiver_prefill_ms": 202.61016709264368, "ttft_ms": 11.743166018277407, "decode_ms": 11.507582967169583}, "total_wall_ms": 11416.990875033662, "ttft_ms": 11.743166018277407, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6449 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e762b48fc37a7271532bdabc", "attempt_id": "01e20a9e4f12", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:09.506764Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 464, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11190.593583043665, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165}, "receiver_prefill_ms": 203.15854204818606, "ttft_ms": 11.63029100280255, "decode_ms": 11.580833001062274}, "total_wall_ms": 11417.369041126221, "ttft_ms": 11.63029100280255, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6450 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d258f30414555b6c349fd536", "attempt_id": "f3e75c686786", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:09.750179Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 467, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11190.593583043665, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165}, "receiver_prefill_ms": 206.60366595257074, "ttft_ms": 11.58149994444102, "decode_ms": 11.544415960088372}, "total_wall_ms": 11420.725042000413, "ttft_ms": 11.58149994444102, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6451 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "8f51afd6a3544ce47ce942b1", "attempt_id": "b3f44e92663a", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:19.234183Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 452, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20426.742333103903, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675}, "receiver_prefill_ms": 200.9144159965217, "ttft_ms": 11.578792007640004, "decode_ms": 11.575500015169382}, "total_wall_ms": 20651.235541095957, "ttft_ms": 11.578792007640004, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6452 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e4298900a03447465092fed8", "attempt_id": "1d53ea775d50", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:19.475048Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 458, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20426.742333103903, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675}, "receiver_prefill_ms": 201.46641694009304, "ttft_ms": 11.554333032108843, "decode_ms": 11.557165998965502}, "total_wall_ms": 20651.710916077718, "ttft_ms": 11.554333032108843, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6453 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c37b86cc101392b4e8285445", "attempt_id": "a99efe5d33dd", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:19.715598Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 458, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20426.742333103903, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675}, "receiver_prefill_ms": 201.89791696611792, "ttft_ms": 11.592500028200448, "decode_ms": 11.51408301666379}, "total_wall_ms": 20652.13854110334, "ttft_ms": 11.592500028200448, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6454 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7c6a520be8ad0b768553c595", "attempt_id": "99eef91f6b57", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:19.956900Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 455, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20426.742333103903, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675}, "receiver_prefill_ms": 204.12816607858986, "ttft_ms": 11.556084034964442, "decode_ms": 11.61312498152256}, "total_wall_ms": 20654.435958131216, "ttft_ms": 11.556084034964442, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6455 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "efe37abcbe89ef07627af361", "attempt_id": "e072f435244f", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:20.199770Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 462, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20426.742333103903, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675}, "receiver_prefill_ms": 202.47225009370595, "ttft_ms": 11.574000003747642, "decode_ms": 11.491082957945764}, "total_wall_ms": 20652.672000112943, "ttft_ms": 11.574000003747642, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6456 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "107b07f4145dc353204941b7", "attempt_id": "d7e68286f56b", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:20.440472Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 461, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20426.742333103903, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675}, "receiver_prefill_ms": 201.78941695485264, "ttft_ms": 11.508582974784076, "decode_ms": 11.591374990530312}, "total_wall_ms": 20652.00604114216, "ttft_ms": 11.508582974784076, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6457 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4e18f2a58fbce166f190266a", "attempt_id": "a66e4550b950", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:20.681374Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 453, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20426.742333103903, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675}, "receiver_prefill_ms": 201.94341707974672, "ttft_ms": 11.617708951234818, "decode_ms": 22.87674997933209}, "total_wall_ms": 20663.58983318787, "ttft_ms": 11.617708951234818, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | |
| 6458 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f2ce6f482e9f27ffae024381", "attempt_id": "dca34cf1804f", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:20.932602Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 454, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20426.742333103903, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675}, "receiver_prefill_ms": 200.86958399042487, "ttft_ms": 11.52995799202472, "decode_ms": 11.586250038817525}, "total_wall_ms": 20651.094458065927, "ttft_ms": 11.52995799202472, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | |
| 6459 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f4011ae97631851c3ee7e766", "attempt_id": "d466ff971558", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:21.172480Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 470, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20426.742333103903, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675}, "receiver_prefill_ms": 204.5193329686299, "ttft_ms": 11.535957921296358, "decode_ms": 11.52787497267127}, "total_wall_ms": 20654.727374087088, "ttft_ms": 11.535957921296358, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6460 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ae4a65c8cac8fe92ce597634", "attempt_id": "ac2cc66452c4", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:21.415617Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 461, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20426.742333103903, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675}, "receiver_prefill_ms": 203.30787496641278, "ttft_ms": 11.5481250686571, "decode_ms": 11.503709014505148}, "total_wall_ms": 20653.487000148743, "ttft_ms": 11.5481250686571, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6461 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b171b72fc315c9e512c9c1ab", "attempt_id": "df8d91e4625f", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:21.657764Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 469, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20426.742333103903, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675}, "receiver_prefill_ms": 208.12520803883672, "ttft_ms": 11.61370798945427, "decode_ms": 11.469958000816405}, "total_wall_ms": 20658.339500194415, "ttft_ms": 11.61370798945427, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6462 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "acc849b3d08b2c5057915d7c", "attempt_id": "43f3de5bba98", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:21.904469Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 465, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20426.742333103903, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675}, "receiver_prefill_ms": 204.23579204361886, "ttft_ms": 11.56979100778699, "decode_ms": 57.78304091654718}, "total_wall_ms": 20700.720541062765, "ttft_ms": 11.56979100778699, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5,646,720", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "2c0bb14ad8ba61e6d23fb3dea5205f2f02c43c95a0cf8e7f93c240ddea626ad4"} | |
| 6463 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "80b55c21aa769e11f06232e2", "attempt_id": "806784074db2", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:22.193386Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 460, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20426.742333103903, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675}, "receiver_prefill_ms": 203.2241669949144, "ttft_ms": 11.535875033587217, "decode_ms": 11.553250020369887}, "total_wall_ms": 20653.444375027902, "ttft_ms": 11.535875033587217, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6464 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "2045fa722f973b166629ff76", "attempt_id": "5194ab2ee3c4", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:22.435091Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 464, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20426.742333103903, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675}, "receiver_prefill_ms": 204.76945908740163, "ttft_ms": 11.539041996002197, "decode_ms": 11.492499965243042}, "total_wall_ms": 20654.90045817569, "ttft_ms": 11.539041996002197, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6465 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "277cd0ddb1dc0228579c6f0b", "attempt_id": "5e894ac62eb3", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:22.678642Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 467, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20426.742333103903, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675}, "receiver_prefill_ms": 204.35237500350922, "ttft_ms": 11.583790997974575, "decode_ms": 11.511042015627027}, "total_wall_ms": 20654.59216607269, "ttft_ms": 11.583790997974575, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6466 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "8684cca1bde15a7bf65cb552", "attempt_id": "66022a20a14e", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:41.408286Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 452, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38908.40608323924, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675, "5": 4931.834749993868, "6": 4301.946583087556, "7": 4939.746499992907, "8": 4308.1359170610085}, "receiver_prefill_ms": 200.94579097349197, "ttft_ms": 11.417291942052543, "decode_ms": 11.446291930042207}, "total_wall_ms": 39132.63620832004, "ttft_ms": 11.417291942052543, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6467 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5168a70642e8a5690249bd9b", "attempt_id": "f0c41f519d89", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:41.648717Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 458, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38908.40608323924, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675, "5": 4931.834749993868, "6": 4301.946583087556, "7": 4939.746499992907, "8": 4308.1359170610085}, "receiver_prefill_ms": 200.74433297850192, "ttft_ms": 11.597416014410555, "decode_ms": 11.473416001535952}, "total_wall_ms": 39132.653500302695, "ttft_ms": 11.597416014410555, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6468 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b0c25fc019d195294f129824", "attempt_id": "8b740728e3ce", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:41.888559Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 458, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38908.40608323924, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675, "5": 4931.834749993868, "6": 4301.946583087556, "7": 4939.746499992907, "8": 4308.1359170610085}, "receiver_prefill_ms": 202.5256670312956, "ttft_ms": 11.530166957527399, "decode_ms": 11.525416048243642}, "total_wall_ms": 39134.37458325643, "ttft_ms": 11.530166957527399, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6469 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0753c06f450b0678c6344cba", "attempt_id": "c09165b2ab24", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:42.129945Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 455, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38908.40608323924, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675, "5": 4931.834749993868, "6": 4301.946583087556, "7": 4939.746499992907, "8": 4308.1359170610085}, "receiver_prefill_ms": 203.65537505131215, "ttft_ms": 11.6252499865368, "decode_ms": 11.536624981090426}, "total_wall_ms": 39135.623958311044, "ttft_ms": 11.6252499865368, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6470 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7658de8168a54706ea455ea9", "attempt_id": "ed79af2a252d", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:42.372543Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 462, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38908.40608323924, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675, "5": 4931.834749993868, "6": 4301.946583087556, "7": 4939.746499992907, "8": 4308.1359170610085}, "receiver_prefill_ms": 200.44012495782226, "ttft_ms": 11.534958030097187, "decode_ms": 11.554750031791627}, "total_wall_ms": 39132.342500262894, "ttft_ms": 11.534958030097187, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6471 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "86558a65a115b2723d2ca5d1", "attempt_id": "584f714fa3cd", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:42.611746Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 461, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38908.40608323924, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675, "5": 4931.834749993868, "6": 4301.946583087556, "7": 4939.746499992907, "8": 4308.1359170610085}, "receiver_prefill_ms": 203.5017079906538, "ttft_ms": 11.600124998949468, "decode_ms": 11.545417015440762}, "total_wall_ms": 39135.43791731354, "ttft_ms": 11.600124998949468, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6472 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4705add754afca10dd943642", "attempt_id": "109062cabb54", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:42.854345Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 453, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38908.40608323924, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675, "5": 4931.834749993868, "6": 4301.946583087556, "7": 4939.746499992907, "8": 4308.1359170610085}, "receiver_prefill_ms": 202.36729201860726, "ttft_ms": 11.570916045457125, "decode_ms": 23.007625015452504}, "total_wall_ms": 39145.730374148116, "ttft_ms": 11.570916045457125, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | |
| 6473 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "29acfc567719fb94547bab5c", "attempt_id": "4e95b5ef1d66", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:43.106889Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 454, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38908.40608323924, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675, "5": 4931.834749993868, "6": 4301.946583087556, "7": 4939.746499992907, "8": 4308.1359170610085}, "receiver_prefill_ms": 202.103832969442, "ttft_ms": 11.636374983936548, "decode_ms": 11.507041985169053}, "total_wall_ms": 39134.05295822304, "ttft_ms": 11.636374983936548, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | |
| 6474 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "203b89cda76a88117927acfd", "attempt_id": "5d3ae8fda989", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:43.347861Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 470, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38908.40608323924, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675, "5": 4931.834749993868, "6": 4301.946583087556, "7": 4939.746499992907, "8": 4308.1359170610085}, "receiver_prefill_ms": 202.15658308006823, "ttft_ms": 11.588749941438437, "decode_ms": 11.586457956582308}, "total_wall_ms": 39134.16225020774, "ttft_ms": 11.588749941438437, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6475 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "cb0112a54b2ab91530061881", "attempt_id": "b4625ba61717", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:43.588943Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 461, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38908.40608323924, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675, "5": 4931.834749993868, "6": 4301.946583087556, "7": 4939.746499992907, "8": 4308.1359170610085}, "receiver_prefill_ms": 201.65483397431672, "ttft_ms": 11.532332981005311, "decode_ms": 11.554541997611523}, "total_wall_ms": 39133.52791615762, "ttft_ms": 11.532332981005311, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6476 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f0ec1d9f0601ce9b0d52e097", "attempt_id": "f119ec23efa4", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:43.829172Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 469, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38908.40608323924, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675, "5": 4931.834749993868, "6": 4301.946583087556, "7": 4939.746499992907, "8": 4308.1359170610085}, "receiver_prefill_ms": 207.1392919169739, "ttft_ms": 11.553416028618813, "decode_ms": 11.523749912157655}, "total_wall_ms": 39139.00450034998, "ttft_ms": 11.553416028618813, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6477 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "12056658164e80e5b64a4408", "attempt_id": "6f8c86e6c2bc", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:44.074741Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 465, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38908.40608323924, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675, "5": 4931.834749993868, "6": 4301.946583087556, "7": 4939.746499992907, "8": 4308.1359170610085}, "receiver_prefill_ms": 203.10245803557336, "ttft_ms": 11.572084040381014, "decode_ms": 57.69333301577717}, "total_wall_ms": 39181.191000156105, "ttft_ms": 11.572084040381014, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5,646,720", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "2c0bb14ad8ba61e6d23fb3dea5205f2f02c43c95a0cf8e7f93c240ddea626ad4"} | |
| 6478 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4c5ddf64c06c4bf305520ffd", "attempt_id": "985c363a0213", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:44.362681Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 460, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38908.40608323924, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675, "5": 4931.834749993868, "6": 4301.946583087556, "7": 4939.746499992907, "8": 4308.1359170610085}, "receiver_prefill_ms": 201.77362498361617, "ttft_ms": 11.604042025282979, "decode_ms": 11.506457929499447}, "total_wall_ms": 39133.6852501845, "ttft_ms": 11.604042025282979, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6479 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "293149f634f67396053180ce", "attempt_id": "dcd61e6735b2", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:44.603148Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 464, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38908.40608323924, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675, "5": 4931.834749993868, "6": 4301.946583087556, "7": 4939.746499992907, "8": 4308.1359170610085}, "receiver_prefill_ms": 204.5530000468716, "ttft_ms": 11.566541972570121, "decode_ms": 11.507750023156404}, "total_wall_ms": 39136.406833305955, "ttft_ms": 11.566541972570121, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6480 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "da6f4356196da5ddf1f1bc9f", "attempt_id": "c93620885371", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:44.846193Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 467, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38908.40608323924, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675, "5": 4931.834749993868, "6": 4301.946583087556, "7": 4939.746499992907, "8": 4308.1359170610085}, "receiver_prefill_ms": 205.05233306903392, "ttft_ms": 11.624832986854017, "decode_ms": 11.526959016919136}, "total_wall_ms": 39136.99137524236, "ttft_ms": 11.624832986854017, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6481 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7f94f53a18e209d47bfb8ddd", "attempt_id": "ec035f1a57c0", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:52.137546Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6965.8001670613885, "hops": {"1": 6965.8001670613885}, "receiver_prefill_ms": 227.33754105865955, "ttft_ms": 11.96925004478544, "decode_ms": 11.930791893973947}, "total_wall_ms": 7217.62954199221, "ttft_ms": 11.96925004478544, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6482 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "6e4edc15fcdb423774811fe5", "attempt_id": "9b2dbf8d61df", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:52.405480Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6965.8001670613885, "hops": {"1": 6965.8001670613885}, "receiver_prefill_ms": 227.46345796622336, "ttft_ms": 11.999250040389597, "decode_ms": 11.93166698794812}, "total_wall_ms": 7217.751334072091, "ttft_ms": 11.999250040389597, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6483 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5dfa922561234f365efc4e06", "attempt_id": "b35ff64d0baa", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:52.673131Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6965.8001670613885, "hops": {"1": 6965.8001670613885}, "receiver_prefill_ms": 226.3631250243634, "ttft_ms": 11.959125055000186, "decode_ms": 83.38604203891009}, "total_wall_ms": 7288.033208111301, "ttft_ms": 11.959125055000186, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "30.0224", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "e28a78bc4deb3cec8beab4bf5b87297d7cc55a3e6f839b43fe6408735d464923"} | |
| 6484 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b5efa056aa8a9ab05e5a1ea1", "attempt_id": "8b686fd86132", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:53.010857Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6965.8001670613885, "hops": {"1": 6965.8001670613885}, "receiver_prefill_ms": 226.75329202320427, "ttft_ms": 11.945249978452921, "decode_ms": 12.137541081756353}, "total_wall_ms": 7217.132042045705, "ttft_ms": 11.945249978452921, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6485 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5c837f57c51575c785d18044", "attempt_id": "0585fa7f8963", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:53.277268Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 601, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6965.8001670613885, "hops": {"1": 6965.8001670613885}, "receiver_prefill_ms": 227.10254206322134, "ttft_ms": 11.983082978986204, "decode_ms": 107.37483308184892}, "total_wall_ms": 7312.79041711241, "ttft_ms": 11.983082978986204, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,009,480", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "30b20d9aae4d7b0587edeefdc2a9a159f73faf6e2570f1d408a415fe92cbf45e"} | |
| 6486 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "df42cc1d9e3606b312e48498", "attempt_id": "ef899a5d9889", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:53.639445Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 605, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6965.8001670613885, "hops": {"1": 6965.8001670613885}, "receiver_prefill_ms": 227.3269579745829, "ttft_ms": 12.147915898822248, "decode_ms": 12.042958987876773}, "total_wall_ms": 7217.956667067483, "ttft_ms": 12.147915898822248, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6487 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "71c20d3d7f450645cb2b88f2", "attempt_id": "4c0a3b666a66", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:53.906924Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 594, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6965.8001670613885, "hops": {"1": 6965.8001670613885}, "receiver_prefill_ms": 226.65075003169477, "ttft_ms": 11.850790935568511, "decode_ms": 11.824292014352977}, "total_wall_ms": 7216.691459063441, "ttft_ms": 11.850790935568511, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | |
| 6488 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "20691cdd16bcd0ee2b7376ce", "attempt_id": "53cd8bbb4df2", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:54.173242Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 596, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6965.8001670613885, "hops": {"1": 6965.8001670613885}, "receiver_prefill_ms": 226.6510840272531, "ttft_ms": 12.024041963741183, "decode_ms": 11.98533398564905}, "total_wall_ms": 7216.995583148673, "ttft_ms": 12.024041963741183, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | |
| 6489 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e325942b42e596df339f4ce2", "attempt_id": "b84a2ed3fc50", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:54.440186Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 612, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6965.8001670613885, "hops": {"1": 6965.8001670613885}, "receiver_prefill_ms": 229.6456249896437, "ttft_ms": 12.049874989315867, "decode_ms": 11.993665946647525}, "total_wall_ms": 7220.0570000568405, "ttft_ms": 12.049874989315867, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6490 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "8992ac2d14527f84647b37e4", "attempt_id": "eba93941dcbd", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:54.709948Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6965.8001670613885, "hops": {"1": 6965.8001670613885}, "receiver_prefill_ms": 227.03824995551258, "ttft_ms": 12.024249997921288, "decode_ms": 11.960541014559567}, "total_wall_ms": 7217.3483750084415, "ttft_ms": 12.024249997921288, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6491 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "714a3b5afc6e23c38f513703", "attempt_id": "dc9527a73532", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:54.976827Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 613, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6965.8001670613885, "hops": {"1": 6965.8001670613885}, "receiver_prefill_ms": 229.2202499229461, "ttft_ms": 12.016541906632483, "decode_ms": 11.87279203440994}, "total_wall_ms": 7219.4512920686975, "ttft_ms": 12.016541906632483, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6492 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d242cfb6a8997d4430ef185c", "attempt_id": "2b7e40d65534", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:55.246057Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6965.8001670613885, "hops": {"1": 6965.8001670613885}, "receiver_prefill_ms": 227.04345802776515, "ttft_ms": 12.091790908016264, "decode_ms": 83.68970802985132}, "total_wall_ms": 7289.284917060286, "ttft_ms": 12.091790908016264, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2707654", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "7799e805760fa6568574360f61d4c7cc9e162842191ff434dfed71076922855e"} | |
| 6493 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "1464ad9d7ff02bdb87b9ffa8", "attempt_id": "3c39669a8a37", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:55.584340Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6965.8001670613885, "hops": {"1": 6965.8001670613885}, "receiver_prefill_ms": 226.7504578921944, "ttft_ms": 12.062042020261288, "decode_ms": 11.881207930855453}, "total_wall_ms": 7217.175125959329, "ttft_ms": 12.062042020261288, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6494 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9ab0b72e3db8ca45d469b799", "attempt_id": "a55451fc0127", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:55.851616Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 607, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6965.8001670613885, "hops": {"1": 6965.8001670613885}, "receiver_prefill_ms": 227.45554195716977, "ttft_ms": 12.18508300371468, "decode_ms": 12.01075001154095}, "total_wall_ms": 7218.157959054224, "ttft_ms": 12.18508300371468, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6495 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b56cb03e9a57414caae162ea", "attempt_id": "48c7a46ea91f", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:56.120825Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 608, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6965.8001670613885, "hops": {"1": 6965.8001670613885}, "receiver_prefill_ms": 227.2582909790799, "ttft_ms": 11.99937507044524, "decode_ms": 12.003959040157497}, "total_wall_ms": 7217.628707992844, "ttft_ms": 11.99937507044524, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6496 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "753f744d5590b2274579aaaa", "attempt_id": "3a6577be9302", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:02.774149Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13349.597501102835, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446}, "receiver_prefill_ms": 226.68308403808624, "ttft_ms": 11.846457957290113, "decode_ms": 11.902624974027276}, "total_wall_ms": 13600.601210142486, "ttft_ms": 11.846457957290113, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6497 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e39732132c6f0d74391922ec", "attempt_id": "20e5b09ce7ad", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:03.041491Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13349.597501102835, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446}, "receiver_prefill_ms": 226.7764579737559, "ttft_ms": 11.951458058319986, "decode_ms": 11.919416952878237}, "total_wall_ms": 13600.782084162347, "ttft_ms": 11.951458058319986, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6498 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "baeb2d37a0177444fe208edd", "attempt_id": "b5dd2a0849b9", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:03.308153Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13349.597501102835, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446}, "receiver_prefill_ms": 226.385583053343, "ttft_ms": 12.16383301652968, "decode_ms": 84.16995801962912}, "total_wall_ms": 13673.025210155174, "ttft_ms": 12.16383301652968, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "30.0224", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "e28a78bc4deb3cec8beab4bf5b87297d7cc55a3e6f839b43fe6408735d464923"} | |
| 6499 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5af9030e32b929ada6ae4d65", "attempt_id": "e81ec9708515", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:03.646825Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13349.597501102835, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446}, "receiver_prefill_ms": 226.614834042266, "ttft_ms": 12.10945809725672, "decode_ms": 12.029916979372501}, "total_wall_ms": 13601.05179308448, "ttft_ms": 12.10945809725672, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6500 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "2b0289cc401be1a010b7970e", "attempt_id": "205c4aa8f5bd", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:03.914060Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 601, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13349.597501102835, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446}, "receiver_prefill_ms": 226.63891699630767, "ttft_ms": 11.959582916460931, "decode_ms": 107.48100001364946}, "total_wall_ms": 13696.246209088713, "ttft_ms": 11.959582916460931, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,009,480", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "30b20d9aae4d7b0587edeefdc2a9a159f73faf6e2570f1d408a415fe92cbf45e"} | |
| 6501 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "49d09c2a99ad0f6c510fe16c", "attempt_id": "333621cb6a37", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:04.277096Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 605, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13349.597501102835, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446}, "receiver_prefill_ms": 226.90795792732388, "ttft_ms": 11.956249945797026, "decode_ms": 12.165375053882599}, "total_wall_ms": 13601.181835052557, "ttft_ms": 11.956249945797026, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6502 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e771788796b151bfd01affc6", "attempt_id": "adc35ad88ada", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:04.543903Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 594, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13349.597501102835, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446}, "receiver_prefill_ms": 226.6862919786945, "ttft_ms": 11.993833002634346, "decode_ms": 11.997084016911685}, "total_wall_ms": 13600.79825099092, "ttft_ms": 11.993833002634346, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | |
| 6503 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a73dc4b558ae698227c1b34c", "attempt_id": "4fb299208db8", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:04.810395Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 596, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13349.597501102835, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446}, "receiver_prefill_ms": 226.766207953915, "ttft_ms": 11.945624952204525, "decode_ms": 11.92041696049273}, "total_wall_ms": 13600.741876056418, "ttft_ms": 11.945624952204525, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | |
| 6504 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "6779ed992be9c3bd7594f65c", "attempt_id": "be021fa9a18a", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:05.076781Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 612, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13349.597501102835, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446}, "receiver_prefill_ms": 229.57179101649672, "ttft_ms": 12.232957989908755, "decode_ms": 11.908375076018274}, "total_wall_ms": 13603.986417059787, "ttft_ms": 12.232957989908755, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6505 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9df0f4564d4b81ae7ac37146", "attempt_id": "54eec9ad4c02", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:05.346551Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13349.597501102835, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446}, "receiver_prefill_ms": 227.05583297647536, "ttft_ms": 12.183125014416873, "decode_ms": 11.90149993635714}, "total_wall_ms": 13601.28316807095, "ttft_ms": 12.183125014416873, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6506 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "75d767fc490e28cee390633b", "attempt_id": "7ea57903743a", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:05.613935Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 613, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13349.597501102835, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446}, "receiver_prefill_ms": 229.49620801955462, "ttft_ms": 11.895584058947861, "decode_ms": 11.921458994038403}, "total_wall_ms": 13603.455210104585, "ttft_ms": 11.895584058947861, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6507 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ba97a7bffcd10007b5c6a840", "attempt_id": "e914bfbd5cd2", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:05.883243Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13349.597501102835, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446}, "receiver_prefill_ms": 227.29645809158683, "ttft_ms": 11.892999988049269, "decode_ms": 83.18300009705126}, "total_wall_ms": 13672.52783512231, "ttft_ms": 11.892999988049269, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2707654", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "7799e805760fa6568574360f61d4c7cc9e162842191ff434dfed71076922855e"} | |
| 6508 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "02bd6a199cfb3648b21e2001", "attempt_id": "2cd7243371e7", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:06.221612Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13349.597501102835, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446}, "receiver_prefill_ms": 227.43054199963808, "ttft_ms": 11.801416985690594, "decode_ms": 11.833208962343633}, "total_wall_ms": 13601.18412610609, "ttft_ms": 11.801416985690594, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6509 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0e3ca81812ba9a2213a67243", "attempt_id": "f02994db75e3", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:06.488573Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 607, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13349.597501102835, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446}, "receiver_prefill_ms": 227.21154196187854, "ttft_ms": 11.821249965578318, "decode_ms": 11.791165918111801}, "total_wall_ms": 13600.940084084868, "ttft_ms": 11.821249965578318, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6510 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "77a55ff61a5cdb2f879b907c", "attempt_id": "7ff7f01f492d", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:06.754885Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 608, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13349.597501102835, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446}, "receiver_prefill_ms": 227.14358288794756, "ttft_ms": 11.809874908067286, "decode_ms": 11.813458055257797}, "total_wall_ms": 13600.895918090828, "ttft_ms": 11.809874908067286, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6511 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "726fbb3883c8b239a09d00f6", "attempt_id": "8bd825633ac5", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:19.667794Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25992.931168177165, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165}, "receiver_prefill_ms": 226.7713330220431, "ttft_ms": 11.888499953784049, "decode_ms": 11.843792046420276}, "total_wall_ms": 26244.002543156967, "ttft_ms": 11.888499953784049, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6512 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "408729447d65b602d16fda14", "attempt_id": "a416a32a0131", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:19.935054Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25992.931168177165, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165}, "receiver_prefill_ms": 227.02529199887067, "ttft_ms": 11.941000004298985, "decode_ms": 11.769249918870628}, "total_wall_ms": 26244.22429315746, "ttft_ms": 11.941000004298985, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6513 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "8118c69625bce55bc1b63621", "attempt_id": "5e81113ab588", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:20.202408Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25992.931168177165, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165}, "receiver_prefill_ms": 227.03762503806502, "ttft_ms": 11.819500010460615, "decode_ms": 82.41174998693168}, "total_wall_ms": 26314.70904313028, "ttft_ms": 11.819500010460615, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "30.0224", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "e28a78bc4deb3cec8beab4bf5b87297d7cc55a3e6f839b43fe6408735d464923"} | |
| 6514 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b41c2cd136f522f97551146f", "attempt_id": "53ab612bb802", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:20.539873Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25992.931168177165, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165}, "receiver_prefill_ms": 226.2377500301227, "ttft_ms": 11.864291969686747, "decode_ms": 11.791291064582765}, "total_wall_ms": 26243.310668156482, "ttft_ms": 11.864291969686747, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6515 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9264f3eb2fa8e2bc881a3644", "attempt_id": "4cc7500fc678", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:20.805585Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 601, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25992.931168177165, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165}, "receiver_prefill_ms": 226.80370800662786, "ttft_ms": 11.763916932977736, "decode_ms": 105.7549580000341}, "total_wall_ms": 26337.785501149483, "ttft_ms": 11.763916932977736, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,009,480", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "30b20d9aae4d7b0587edeefdc2a9a159f73faf6e2570f1d408a415fe92cbf45e"} | |
| 6516 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "379fdd74771035e2eb6e28a3", "attempt_id": "bfabffb1648e", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:21.165503Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 605, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25992.931168177165, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165}, "receiver_prefill_ms": 226.89308295957744, "ttft_ms": 11.791458004154265, "decode_ms": 11.826207977719605}, "total_wall_ms": 26243.955460144207, "ttft_ms": 11.791458004154265, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6517 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a1c0cc02f0feb55977a59249", "attempt_id": "4b5e754b980d", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:21.431760Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 594, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25992.931168177165, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165}, "receiver_prefill_ms": 226.97441698983312, "ttft_ms": 11.828124988824129, "decode_ms": 11.864541913382709}, "total_wall_ms": 26244.10158523824, "ttft_ms": 11.828124988824129, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | |
| 6518 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "cfd7f566c9336b798f169eef", "attempt_id": "0d87558657c2", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:21.698172Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 596, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25992.931168177165, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165}, "receiver_prefill_ms": 227.1051249699667, "ttft_ms": 11.855500051751733, "decode_ms": 11.904416023753583}, "total_wall_ms": 26244.29912713822, "ttft_ms": 11.855500051751733, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | |
| 6519 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a21f1bbe758ee8cef8f172c3", "attempt_id": "2cbd47ca92e9", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:21.965020Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 612, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25992.931168177165, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165}, "receiver_prefill_ms": 229.09416700713336, "ttft_ms": 11.718250112608075, "decode_ms": 11.877542012371123}, "total_wall_ms": 26246.146918158047, "ttft_ms": 11.718250112608075, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6520 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "58d9a604baa62d519acba4ee", "attempt_id": "de7fc439cc86", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:22.233270Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25992.931168177165, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165}, "receiver_prefill_ms": 226.9183750031516, "ttft_ms": 11.839916929602623, "decode_ms": 11.85870892368257}, "total_wall_ms": 26244.057793170214, "ttft_ms": 11.839916929602623, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6521 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "73c3858f29e819400209778f", "attempt_id": "a32525a59de5", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:22.500143Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 613, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25992.931168177165, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165}, "receiver_prefill_ms": 229.04245904646814, "ttft_ms": 11.789832962676883, "decode_ms": 11.730375001206994}, "total_wall_ms": 26246.00646016188, "ttft_ms": 11.789832962676883, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6522 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "58d2d7acf81624a6f0c6dda3", "attempt_id": "c98af0ed5f82", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:22.768782Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25992.931168177165, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165}, "receiver_prefill_ms": 227.17649990227073, "ttft_ms": 12.067832984030247, "decode_ms": 82.63779198750854}, "total_wall_ms": 26315.369501244277, "ttft_ms": 12.067832984030247, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2707654", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "7799e805760fa6568574360f61d4c7cc9e162842191ff434dfed71076922855e"} | |
| 6523 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "724f02747b38012dd4315efb", "attempt_id": "ab1a4f595e42", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:23.107341Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25992.931168177165, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165}, "receiver_prefill_ms": 226.6135000390932, "ttft_ms": 11.80862495675683, "decode_ms": 11.871666996739805}, "total_wall_ms": 26243.756584241055, "ttft_ms": 11.80862495675683, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6524 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "21be50c1530487d70d7108d6", "attempt_id": "e8a6251fe433", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:23.373315Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 607, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25992.931168177165, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165}, "receiver_prefill_ms": 226.42879199702293, "ttft_ms": 11.861625011079013, "decode_ms": 11.85912499204278}, "total_wall_ms": 26243.610210251063, "ttft_ms": 11.861625011079013, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6525 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ef5155954acc1c0016fa85be", "attempt_id": "c49f4b2a1761", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:23.639231Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 608, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25992.931168177165, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165}, "receiver_prefill_ms": 227.08595800213516, "ttft_ms": 12.17612496111542, "decode_ms": 11.82437501847744}, "total_wall_ms": 26244.54262619838, "ttft_ms": 12.17612496111542, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6526 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "751370cd81892dd40de17903", "attempt_id": "769757d4d58d", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:49.213249Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51294.487459235825, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165, "5": 6315.4535830253735, "6": 6335.9819169854745, "7": 6312.74179101456, "8": 6337.379000033252}, "receiver_prefill_ms": 226.88433295115829, "ttft_ms": 12.047790922224522, "decode_ms": 11.889833025634289}, "total_wall_ms": 51545.84158421494, "ttft_ms": 12.047790922224522, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6527 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "880b3a3219cb96b64f4ccaf4", "attempt_id": "b087eaeacc35", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:49.480557Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51294.487459235825, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165, "5": 6315.4535830253735, "6": 6335.9819169854745, "7": 6312.74179101456, "8": 6337.379000033252}, "receiver_prefill_ms": 227.0825420273468, "ttft_ms": 11.990125058218837, "decode_ms": 11.91887492313981}, "total_wall_ms": 51545.9824182326, "ttft_ms": 11.990125058218837, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6528 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e1dd3029f476bf30c5bc5707", "attempt_id": "bc96537f758d", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:49.747123Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51294.487459235825, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165, "5": 6315.4535830253735, "6": 6335.9819169854745, "7": 6312.74179101456, "8": 6337.379000033252}, "receiver_prefill_ms": 227.089999942109, "ttft_ms": 12.071042088791728, "decode_ms": 82.94683299027383}, "total_wall_ms": 51617.09904228337, "ttft_ms": 12.071042088791728, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "30.0224", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "e28a78bc4deb3cec8beab4bf5b87297d7cc55a3e6f839b43fe6408735d464923"} | |
| 6529 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "565e07b4e0655f8bacabac69", "attempt_id": "1b59b9220139", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:50.085031Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51294.487459235825, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165, "5": 6315.4535830253735, "6": 6335.9819169854745, "7": 6312.74179101456, "8": 6337.379000033252}, "receiver_prefill_ms": 227.21041610930115, "ttft_ms": 11.838041944429278, "decode_ms": 11.842875042930245}, "total_wall_ms": 51545.88004213292, "ttft_ms": 11.838041944429278, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6530 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b6ce8280ab8b1f23b48b50e5", "attempt_id": "25daa4a443a8", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:50.351570Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 601, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51294.487459235825, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165, "5": 6315.4535830253735, "6": 6335.9819169854745, "7": 6312.74179101456, "8": 6337.379000033252}, "receiver_prefill_ms": 227.19112504273653, "ttft_ms": 11.835957993753254, "decode_ms": 106.63254198152572}, "total_wall_ms": 51640.638959244825, "ttft_ms": 11.835957993753254, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,009,480", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "30b20d9aae4d7b0587edeefdc2a9a159f73faf6e2570f1d408a415fe92cbf45e"} | |
| 6531 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "8b453767f8031f595750575f", "attempt_id": "a2ea420b2a16", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:50.712977Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 605, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51294.487459235825, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165, "5": 6315.4535830253735, "6": 6335.9819169854745, "7": 6312.74179101456, "8": 6337.379000033252}, "receiver_prefill_ms": 227.34225005842745, "ttft_ms": 11.902292026206851, "decode_ms": 11.866874992847443}, "total_wall_ms": 51546.0947091924, "ttft_ms": 11.902292026206851, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6532 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "113e37ab97f0e52acb231f53", "attempt_id": "3d0b15461043", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:50.979840Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 594, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51294.487459235825, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165, "5": 6315.4535830253735, "6": 6335.9819169854745, "7": 6312.74179101456, "8": 6337.379000033252}, "receiver_prefill_ms": 226.8207500455901, "ttft_ms": 11.867458000779152, "decode_ms": 11.909457971341908}, "total_wall_ms": 51545.57116725482, "ttft_ms": 11.867458000779152, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | |
| 6533 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "da5ac261e1d1012fb619c1c6", "attempt_id": "4a72e4c1f38c", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:51.245966Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 596, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51294.487459235825, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165, "5": 6315.4535830253735, "6": 6335.9819169854745, "7": 6312.74179101456, "8": 6337.379000033252}, "receiver_prefill_ms": 226.81791603099555, "ttft_ms": 12.087582959793508, "decode_ms": 11.90095895435661}, "total_wall_ms": 51545.81116826739, "ttft_ms": 12.087582959793508, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | |
| 6534 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "203e68c27d9d23918f1d07cd", "attempt_id": "8c48eb1ca7ec", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:51.512118Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 612, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51294.487459235825, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165, "5": 6315.4535830253735, "6": 6335.9819169854745, "7": 6312.74179101456, "8": 6337.379000033252}, "receiver_prefill_ms": 228.855749941431, "ttft_ms": 12.015124899335206, "decode_ms": 11.869041016325355}, "total_wall_ms": 51547.71729221102, "ttft_ms": 12.015124899335206, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6535 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "12e68f1843b22f3e1c63ca8f", "attempt_id": "fcc416ee8e86", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:51.780479Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51294.487459235825, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165, "5": 6315.4535830253735, "6": 6335.9819169854745, "7": 6312.74179101456, "8": 6337.379000033252}, "receiver_prefill_ms": 227.07966703455895, "ttft_ms": 12.022125069051981, "decode_ms": 11.914458009414375}, "total_wall_ms": 51546.01620929316, "ttft_ms": 12.022125069051981, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6536 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7ec61b8c3502b3dd603f5b34", "attempt_id": "c2c2c824e6f2", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:52.047154Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 613, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51294.487459235825, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165, "5": 6315.4535830253735, "6": 6335.9819169854745, "7": 6312.74179101456, "8": 6337.379000033252}, "receiver_prefill_ms": 229.16283400263637, "ttft_ms": 11.858124984428287, "decode_ms": 11.946166981942952}, "total_wall_ms": 51547.945667174645, "ttft_ms": 11.858124984428287, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6537 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "1d0d129ea06720cfa36d3a6f", "attempt_id": "68c3d99dd648", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:52.315792Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51294.487459235825, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165, "5": 6315.4535830253735, "6": 6335.9819169854745, "7": 6312.74179101456, "8": 6337.379000033252}, "receiver_prefill_ms": 227.40304097533226, "ttft_ms": 11.915542068891227, "decode_ms": 82.97120907809585}, "total_wall_ms": 51617.27400019299, "ttft_ms": 11.915542068891227, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2707654", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "7799e805760fa6568574360f61d4c7cc9e162842191ff434dfed71076922855e"} | |
| 6538 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "02c02a185e7fd154972915ca", "attempt_id": "f4d5caed64a8", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:52.653727Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51294.487459235825, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165, "5": 6315.4535830253735, "6": 6335.9819169854745, "7": 6312.74179101456, "8": 6337.379000033252}, "receiver_prefill_ms": 227.34025004319847, "ttft_ms": 11.922917095944285, "decode_ms": 11.88620796892792}, "total_wall_ms": 51546.11158417538, "ttft_ms": 11.922917095944285, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6539 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7372cffe659dae5fcf305de9", "attempt_id": "39d376023187", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:52.920359Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 607, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51294.487459235825, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165, "5": 6315.4535830253735, "6": 6335.9819169854745, "7": 6312.74179101456, "8": 6337.379000033252}, "receiver_prefill_ms": 227.38029202446342, "ttft_ms": 11.933458037674427, "decode_ms": 11.882791994139552}, "total_wall_ms": 51546.17308429442, "ttft_ms": 11.933458037674427, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6540 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "aaa3fa059e7f87cdad36afbb", "attempt_id": "d98f39344b57", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:53.186754Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 608, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51294.487459235825, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165, "5": 6315.4535830253735, "6": 6335.9819169854745, "7": 6312.74179101456, "8": 6337.379000033252}, "receiver_prefill_ms": 227.1588749717921, "ttft_ms": 11.959374998696148, "decode_ms": 11.879750061780214}, "total_wall_ms": 51545.975125278346, "ttft_ms": 11.959374998696148, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6541 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5c0a46794d470a83dc5eaf06", "attempt_id": "f6a53a4ae398", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:00.391363Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 440, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6936.468709027395, "hops": {"1": 6936.468709027395}, "receiver_prefill_ms": 164.26933300681412, "ttft_ms": 11.80416694842279, "decode_ms": 11.790709104388952}, "total_wall_ms": 7124.787209089845, "ttft_ms": 11.80416694842279, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6542 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9a054945779b95b752f6a5b5", "attempt_id": "b9fefcd8a26d", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:00.595688Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 445, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6936.468709027395, "hops": {"1": 6936.468709027395}, "receiver_prefill_ms": 164.79070798959583, "ttft_ms": 12.047125026583672, "decode_ms": 130.07595902308822}, "total_wall_ms": 7243.934668018483, "ttft_ms": 12.047125026583672, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 568-G in Mont-Laurier", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.5}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "98e007faa5a10742ad74f2778a64e3ea0d6b72bec1c0392200d475073d7bf082"} | |
| 6543 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "6c1dfbb4e681b18651889980", "attempt_id": "a001a2bb4d9c", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:00.918833Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 445, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6936.468709027395, "hops": {"1": 6936.468709027395}, "receiver_prefill_ms": 165.1084590703249, "ttft_ms": 11.83262502308935, "decode_ms": 11.728542041964829}, "total_wall_ms": 7125.536459032446, "ttft_ms": 11.83262502308935, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6544 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "002b83b453a65db7e45424d8", "attempt_id": "1dddba50ec46", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:01.124226Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 440, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6936.468709027395, "hops": {"1": 6936.468709027395}, "receiver_prefill_ms": 164.0583339612931, "ttft_ms": 12.081082910299301, "decode_ms": 11.792624951340258}, "total_wall_ms": 7124.9332500156015, "ttft_ms": 12.081082910299301, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6545 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "63e2b46825b1675b0b6f8fb1", "attempt_id": "f04a9c2fefc3", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:01.328199Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 446, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6936.468709027395, "hops": {"1": 6936.468709027395}, "receiver_prefill_ms": 164.67762493994087, "ttft_ms": 11.896417010575533, "decode_ms": 11.777332983911037}, "total_wall_ms": 7125.347375986166, "ttft_ms": 11.896417010575533, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6546 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "eab56dedd883c8843d5ff1cb", "attempt_id": "903634cd4f59", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:01.533843Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 450, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6936.468709027395, "hops": {"1": 6936.468709027395}, "receiver_prefill_ms": 184.89924992900342, "ttft_ms": 12.040583998896182, "decode_ms": 11.881624930538237}, "total_wall_ms": 7145.81962605007, "ttft_ms": 12.040583998896182, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6547 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b8da8ea509495646817ef35e", "attempt_id": "e9cddc7c6db5", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:01.759234Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 439, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6936.468709027395, "hops": {"1": 6936.468709027395}, "receiver_prefill_ms": 164.23270793166012, "ttft_ms": 11.796916020102799, "decode_ms": 11.788291041739285}, "total_wall_ms": 7124.669751035981, "ttft_ms": 11.796916020102799, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | |
| 6548 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "bedfd838642aeacb43c7693e", "attempt_id": "16774b407c62", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:01.963156Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 441, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6936.468709027395, "hops": {"1": 6936.468709027395}, "receiver_prefill_ms": 164.2329579917714, "ttft_ms": 11.775291990488768, "decode_ms": 11.805000016465783}, "total_wall_ms": 7124.653875012882, "ttft_ms": 11.775291990488768, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | |
| 6549 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0155b74fcff3d4ac35ff5f40", "attempt_id": "b6ea30e798b4", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:02.166460Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 457, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6936.468709027395, "hops": {"1": 6936.468709027395}, "receiver_prefill_ms": 185.86870795115829, "ttft_ms": 11.836208985187113, "decode_ms": 11.81591593194753}, "total_wall_ms": 7146.448876010254, "ttft_ms": 11.836208985187113, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6550 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ee38a8c6ca620154c4030cb8", "attempt_id": "d0c81646384e", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:02.392062Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 448, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6936.468709027395, "hops": {"1": 6936.468709027395}, "receiver_prefill_ms": 165.6753340503201, "ttft_ms": 11.78512501064688, "decode_ms": 82.25158299319446}, "total_wall_ms": 7196.570542058907, "ttft_ms": 11.78512501064688, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "9134435", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "f7384892cb4f9a38f6115f91da5fec3f0d7e24e47877737b0f34e2b4a6af7d5a"} | |
| 6551 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c2ac17ce3dc8a07f36ec94ec", "attempt_id": "9e15ad02f4e2", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:02.667654Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 458, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6936.468709027395, "hops": {"1": 6936.468709027395}, "receiver_prefill_ms": 185.01112493686378, "ttft_ms": 11.85000000987202, "decode_ms": 11.756583000533283}, "total_wall_ms": 7145.507792942226, "ttft_ms": 11.85000000987202, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6552 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ae74c942b2725919916b8221", "attempt_id": "786b6dceeadf", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:02.892070Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 451, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6936.468709027395, "hops": {"1": 6936.468709027395}, "receiver_prefill_ms": 184.76804194506258, "ttft_ms": 11.788417003117502, "decode_ms": 82.40608300548047}, "total_wall_ms": 7215.8218760741875, "ttft_ms": 11.788417003117502, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8066734", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "167c75fdd6a41fca64228797ab8f3a1a3f994475246df0bffb2e060d5d2e4ff0"} | |
| 6553 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "6327d0f270950a8d968009a3", "attempt_id": "7f3d287266c7", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:03.186225Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 448, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6936.468709027395, "hops": {"1": 6936.468709027395}, "receiver_prefill_ms": 165.31150008086115, "ttft_ms": 11.79787504952401, "decode_ms": 11.764207971282303}, "total_wall_ms": 7125.712918001227, "ttft_ms": 11.79787504952401, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6554 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "387acff2e427afe098414fcd", "attempt_id": "153b3034f20c", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:03.390365Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 452, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6936.468709027395, "hops": {"1": 6936.468709027395}, "receiver_prefill_ms": 185.54616696201265, "ttft_ms": 11.814708006568253, "decode_ms": 11.842208099551499}, "total_wall_ms": 7146.036084042862, "ttft_ms": 11.814708006568253, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6555 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "2e89e7502d1437bc71263336", "attempt_id": "f89836bf53e4", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:03.614845Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 453, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6936.468709027395, "hops": {"1": 6936.468709027395}, "receiver_prefill_ms": 185.07358303759247, "ttft_ms": 11.805834015831351, "decode_ms": 11.80404203478247}, "total_wall_ms": 7145.520791993476, "ttft_ms": 11.805834015831351, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6556 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "fadf6b80a3a17a3f7a9ffb6b", "attempt_id": "e2bf4ebd5cee", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:08.387120Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 445, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11483.192084007896, "hops": {"1": 6936.468709027395, "2": 4546.723374980502}, "receiver_prefill_ms": 165.30312492977828, "ttft_ms": 11.850125039927661, "decode_ms": 117.14154202491045}, "total_wall_ms": 11777.991416980512, "ttft_ms": 11.850125039927661, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "BU-55G-3254", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "98227e32c2121a7856e6d2b32b74598ce6f4183c2ec3eec7ce4b9b0b3f66b98b"} | |
| 6557 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e1feda63120a084bc52c6f3c", "attempt_id": "5d5d2a002589", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:08.698202Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 450, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11483.192084007896, "hops": {"1": 6936.468709027395, "2": 4546.723374980502}, "receiver_prefill_ms": 184.7597499145195, "ttft_ms": 12.01541698537767, "decode_ms": 129.88954095635563}, "total_wall_ms": 11810.371709056199, "ttft_ms": 12.01541698537767, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 568-G in Mont-Laurier", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.5}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "98e007faa5a10742ad74f2778a64e3ea0d6b72bec1c0392200d475073d7bf082"} | |
| 6558 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "66066b99de29d4f4d57fa7c0", "attempt_id": "9636d61fa06e", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:09.041975Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 450, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11483.192084007896, "hops": {"1": 6936.468709027395, "2": 4546.723374980502}, "receiver_prefill_ms": 184.02974994387478, "ttft_ms": 11.894749943166971, "decode_ms": 11.993292020633817}, "total_wall_ms": 11691.599541925825, "ttft_ms": 11.894749943166971, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6559 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7e2ebc2683ad6e5785804f22", "attempt_id": "3589f293cda4", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:09.266158Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 445, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11483.192084007896, "hops": {"1": 6936.468709027395, "2": 4546.723374980502}, "receiver_prefill_ms": 164.52316695358604, "ttft_ms": 11.815292062237859, "decode_ms": 11.850083945319057}, "total_wall_ms": 11671.759251039475, "ttft_ms": 11.815292062237859, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6560 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "50db5edd817167b057d9d502", "attempt_id": "92b62d67fc8f", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:09.470107Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 451, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11483.192084007896, "hops": {"1": 6936.468709027395, "2": 4546.723374980502}, "receiver_prefill_ms": 184.84904197975993, "ttft_ms": 11.632499983534217, "decode_ms": 11.661750031635165}, "total_wall_ms": 11691.708042053506, "ttft_ms": 11.632499983534217, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6561 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "71337a6adc8a5870360ed22b", "attempt_id": "24fef414b72a", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:09.693550Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 455, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11483.192084007896, "hops": {"1": 6936.468709027395, "2": 4546.723374980502}, "receiver_prefill_ms": 185.38833293132484, "ttft_ms": 12.018500012345612, "decode_ms": 11.815333971753716}, "total_wall_ms": 11692.906376090832, "ttft_ms": 12.018500012345612, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6562 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "799e8a4d60036fcaf14ef86f", "attempt_id": "8057b02d18cf", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:09.918867Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 444, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11483.192084007896, "hops": {"1": 6936.468709027395, "2": 4546.723374980502}, "receiver_prefill_ms": 164.20979204121977, "ttft_ms": 11.923499987460673, "decode_ms": 11.82508294004947}, "total_wall_ms": 11671.63574998267, "ttft_ms": 11.923499987460673, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | |
| 6563 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "abef668c0b7a6ccb6652cae4", "attempt_id": "446a113001eb", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:10.123429Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 446, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11483.192084007896, "hops": {"1": 6936.468709027395, "2": 4546.723374980502}, "receiver_prefill_ms": 164.78812508285046, "ttft_ms": 11.933541973121464, "decode_ms": 11.839375016279519}, "total_wall_ms": 11672.191416961141, "ttft_ms": 11.933541973121464, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | |
| 6564 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "2e1246988ad4c1c037916b9e", "attempt_id": "990405aa52e1", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:10.328215Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 462, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11483.192084007896, "hops": {"1": 6936.468709027395, "2": 4546.723374980502}, "receiver_prefill_ms": 185.66583306528628, "ttft_ms": 11.888416949659586, "decode_ms": 11.815374949947}, "total_wall_ms": 11693.00425099209, "ttft_ms": 11.888416949659586, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6565 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7a0d4a27493151e512f10672", "attempt_id": "0bb8379b6927", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:10.553594Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 453, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11483.192084007896, "hops": {"1": 6936.468709027395, "2": 4546.723374980502}, "receiver_prefill_ms": 184.838708024472, "ttft_ms": 11.858458048664033, "decode_ms": 11.804417008534074}, "total_wall_ms": 11692.200417048298, "ttft_ms": 11.858458048664033, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6566 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "10079aa7ca414ab52eafb69e", "attempt_id": "e2ed84f5328f", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:10.777591Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 463, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11483.192084007896, "hops": {"1": 6936.468709027395, "2": 4546.723374980502}, "receiver_prefill_ms": 185.35545794293284, "ttft_ms": 11.964083067141473, "decode_ms": 11.907332926057279}, "total_wall_ms": 11692.946959054098, "ttft_ms": 11.964083067141473, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6567 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f1751334c61a6544fcf83837", "attempt_id": "570bba19f253", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:11.003711Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 456, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11483.192084007896, "hops": {"1": 6936.468709027395, "2": 4546.723374980502}, "receiver_prefill_ms": 185.12491695582867, "ttft_ms": 11.866500019095838, "decode_ms": 82.7463329769671}, "total_wall_ms": 11763.31404200755, "ttft_ms": 11.866500019095838, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8066734", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "167c75fdd6a41fca64228797ab8f3a1a3f994475246df0bffb2e060d5d2e4ff0"} | |
| 6568 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e89b2dcd24531c8826a8bab5", "attempt_id": "5beaba253e10", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:11.299335Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 453, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11483.192084007896, "hops": {"1": 6936.468709027395, "2": 4546.723374980502}, "receiver_prefill_ms": 185.42724999133497, "ttft_ms": 11.843333020806313, "decode_ms": 11.862916988320649}, "total_wall_ms": 11692.689917981625, "ttft_ms": 11.843333020806313, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6569 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "fc6513c10527df06b064bcb0", "attempt_id": "818234321c94", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:11.523472Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 457, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11483.192084007896, "hops": {"1": 6936.468709027395, "2": 4546.723374980502}, "receiver_prefill_ms": 185.0474999519065, "ttft_ms": 11.861416045576334, "decode_ms": 11.87649997882545}, "total_wall_ms": 11692.399959079921, "ttft_ms": 11.861416045576334, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6570 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c1330581de4bcfb078be8cd3", "attempt_id": "4143f91773ab", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:11.748188Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 458, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11483.192084007896, "hops": {"1": 6936.468709027395, "2": 4546.723374980502}, "receiver_prefill_ms": 185.00295898411423, "ttft_ms": 11.922916048206389, "decode_ms": 11.834541917778552}, "total_wall_ms": 11692.35262600705, "ttft_ms": 11.922916048206389, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6571 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "16860c18e815a31fc1d6290c", "attempt_id": "af19488cc824", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:21.095631Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 445, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20603.92000002321, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715}, "receiver_prefill_ms": 164.44495902396739, "ttft_ms": 11.853790958411992, "decode_ms": 12.021875008940697}, "total_wall_ms": 20792.664124979638, "ttft_ms": 11.853790958411992, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6572 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e1b0632f3877eef1cdeffd83", "attempt_id": "d18f86d9645f", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:21.300363Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 450, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20603.92000002321, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715}, "receiver_prefill_ms": 184.59491699468344, "ttft_ms": 11.866250075399876, "decode_ms": 129.9334999639541}, "total_wall_ms": 20930.726041086018, "ttft_ms": 11.866250075399876, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 568-G in Mont-Laurier", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.5}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "98e007faa5a10742ad74f2778a64e3ea0d6b72bec1c0392200d475073d7bf082"} | |
| 6573 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ad77b3a14eb57439dd764b47", "attempt_id": "2ec5efef1d5e", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:21.642320Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 450, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20603.92000002321, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715}, "receiver_prefill_ms": 183.82549996022135, "ttft_ms": 11.845917091704905, "decode_ms": 11.891374946571887}, "total_wall_ms": 20811.870167031884, "ttft_ms": 11.845917091704905, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6574 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "50c979e2fbd85e95a0c564d8", "attempt_id": "e23e623ad151", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:21.865499Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 445, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20603.92000002321, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715}, "receiver_prefill_ms": 164.1758339246735, "ttft_ms": 11.8742500199005, "decode_ms": 11.805207934230566}, "total_wall_ms": 20792.14008396957, "ttft_ms": 11.8742500199005, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6575 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "92f883c1e23f82b06a6a65f2", "attempt_id": "d3df79261999", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:22.068800Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 451, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20603.92000002321, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715}, "receiver_prefill_ms": 185.03374990541488, "ttft_ms": 11.841833009384573, "decode_ms": 11.808292008936405}, "total_wall_ms": 20812.969458987936, "ttft_ms": 11.841833009384573, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6576 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "349cca834979b7ec2d89e18e", "attempt_id": "7ec2854dbc72", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:22.292678Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 455, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20603.92000002321, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715}, "receiver_prefill_ms": 185.4181250091642, "ttft_ms": 11.826375033706427, "decode_ms": 11.85033400543034}, "total_wall_ms": 20813.36970801931, "ttft_ms": 11.826375033706427, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6577 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a447592486df7a43f7858ee0", "attempt_id": "4ad05350b006", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:22.516739Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 444, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20603.92000002321, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715}, "receiver_prefill_ms": 164.16779207065701, "ttft_ms": 11.946332990191877, "decode_ms": 11.776415980421007}, "total_wall_ms": 20792.149875080213, "ttft_ms": 11.946332990191877, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | |
| 6578 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "90eccaf77c9a6a72aa1e095d", "attempt_id": "ffb7e7135bf0", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:22.719505Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 446, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20603.92000002321, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715}, "receiver_prefill_ms": 164.6102089434862, "ttft_ms": 11.85841707047075, "decode_ms": 11.880625039339066}, "total_wall_ms": 20792.62541711796, "ttft_ms": 11.85841707047075, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | |
| 6579 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "936324d65d8c0a69e0195c8d", "attempt_id": "b0e05e044c09", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:22.923247Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 462, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20603.92000002321, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715}, "receiver_prefill_ms": 185.19008299335837, "ttft_ms": 11.860250029712915, "decode_ms": 11.795790982432663}, "total_wall_ms": 20813.140416983515, "ttft_ms": 11.860250029712915, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6580 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "73ad64ba128ba84d04f6c580", "attempt_id": "03eaa230538e", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:23.147509Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 453, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20603.92000002321, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715}, "receiver_prefill_ms": 184.54370903782547, "ttft_ms": 11.871750000864267, "decode_ms": 11.827250011265278}, "total_wall_ms": 20812.533666961826, "ttft_ms": 11.871750000864267, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6581 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "22dacd8f2646ee15f7da5c41", "attempt_id": "3fb733cecad0", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:23.371012Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 463, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20603.92000002321, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715}, "receiver_prefill_ms": 185.72470801882446, "ttft_ms": 11.868500034324825, "decode_ms": 11.852708994410932}, "total_wall_ms": 20813.73854202684, "ttft_ms": 11.868500034324825, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6582 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7746f175dc12b1ba6e7f3a25", "attempt_id": "2d4c8067449c", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:23.595542Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 456, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20603.92000002321, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715}, "receiver_prefill_ms": 185.0237080361694, "ttft_ms": 11.849625036120415, "decode_ms": 82.70766702480614}, "total_wall_ms": 20883.87183402665, "ttft_ms": 11.849625036120415, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8066734", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "167c75fdd6a41fca64228797ab8f3a1a3f994475246df0bffb2e060d5d2e4ff0"} | |
| 6583 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "913c805305f049c259216d9e", "attempt_id": "87891aab8478", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:23.890402Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 453, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20603.92000002321, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715}, "receiver_prefill_ms": 185.41999999433756, "ttft_ms": 11.828709044493735, "decode_ms": 11.834709090180695}, "total_wall_ms": 20813.37879097555, "ttft_ms": 11.828709044493735, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6584 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d478b15190aca223b51f5c76", "attempt_id": "3e5fe5dde7f6", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:24.115247Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 457, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20603.92000002321, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715}, "receiver_prefill_ms": 184.9063750123605, "ttft_ms": 11.823124950751662, "decode_ms": 11.84625003952533}, "total_wall_ms": 20812.855791067705, "ttft_ms": 11.823124950751662, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6585 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "cf124bb63534ad2b693d63c7", "attempt_id": "2b5c55ab6000", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:24.338817Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 458, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20603.92000002321, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715}, "receiver_prefill_ms": 185.54220802616328, "ttft_ms": 11.914875009097159, "decode_ms": 11.851749964989722}, "total_wall_ms": 20813.61258297693, "ttft_ms": 11.914875009097159, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6586 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "27407fe5ddd3bded10c90e65", "attempt_id": "29fc9dd12987", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:42.808196Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 445, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38844.63216701988, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715, "5": 4559.562999987975, "6": 4558.797375066206, "7": 4563.401291961782, "8": 4558.95049998071}, "receiver_prefill_ms": 164.1359580680728, "ttft_ms": 11.880041914992034, "decode_ms": 11.849083006381989}, "total_wall_ms": 39032.90354204364, "ttft_ms": 11.880041914992034, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6587 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "55d70990fc57abdde8c1c8d5", "attempt_id": "ae05d511537a", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:43.012743Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 450, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38844.63216701988, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715, "5": 4559.562999987975, "6": 4558.797375066206, "7": 4563.401291961782, "8": 4558.95049998071}, "receiver_prefill_ms": 184.66995900962502, "ttft_ms": 11.843707994557917, "decode_ms": 129.85899997875094}, "total_wall_ms": 39171.41804203857, "ttft_ms": 11.843707994557917, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 568-G in Mont-Laurier", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.5}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "98e007faa5a10742ad74f2778a64e3ea0d6b72bec1c0392200d475073d7bf082"} | |
| 6588 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "befb512ec2e1301efd8e1569", "attempt_id": "55d8bcd5417a", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:43.355125Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 450, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38844.63216701988, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715, "5": 4559.562999987975, "6": 4558.797375066206, "7": 4563.401291961782, "8": 4558.95049998071}, "receiver_prefill_ms": 184.86441601999104, "ttft_ms": 11.810792027972639, "decode_ms": 11.849874979816377}, "total_wall_ms": 39053.5123340087, "ttft_ms": 11.810792027972639, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6589 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "221f2a58197af486576ea3fa", "attempt_id": "7cd0aaa92bbc", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:43.579415Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 445, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38844.63216701988, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715, "5": 4559.562999987975, "6": 4558.797375066206, "7": 4563.401291961782, "8": 4558.95049998071}, "receiver_prefill_ms": 164.83379201963544, "ttft_ms": 11.806166963651776, "decode_ms": 11.875291005708277}, "total_wall_ms": 39033.50550006144, "ttft_ms": 11.806166963651776, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6590 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4f91af91cf769eed164604b9", "attempt_id": "754de6a6eaf6", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:43.783284Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 451, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38844.63216701988, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715, "5": 4559.562999987975, "6": 4558.797375066206, "7": 4563.401291961782, "8": 4558.95049998071}, "receiver_prefill_ms": 185.05345797166228, "ttft_ms": 11.875708936713636, "decode_ms": 12.00695801526308}, "total_wall_ms": 39053.94362506922, "ttft_ms": 11.875708936713636, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6591 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "73f47c6d5c89beeb639b5467", "attempt_id": "3471a8240b39", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:44.007696Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 455, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38844.63216701988, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715, "5": 4559.562999987975, "6": 4558.797375066206, "7": 4563.401291961782, "8": 4558.95049998071}, "receiver_prefill_ms": 185.17374992370605, "ttft_ms": 11.88095798715949, "decode_ms": 11.854749987833202}, "total_wall_ms": 39053.93200099934, "ttft_ms": 11.88095798715949, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6592 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "df07df6dea0cf6065addfa76", "attempt_id": "733b36c45770", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:44.231889Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 444, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38844.63216701988, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715, "5": 4559.562999987975, "6": 4558.797375066206, "7": 4563.401291961782, "8": 4558.95049998071}, "receiver_prefill_ms": 164.25391589291394, "ttft_ms": 11.809166986495256, "decode_ms": 11.838875012472272}, "total_wall_ms": 39032.8872500686, "ttft_ms": 11.809166986495256, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | |
| 6593 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ab9e8dba7be7b85d63382125", "attempt_id": "ff1491509e5e", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:44.435308Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 446, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38844.63216701988, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715, "5": 4559.562999987975, "6": 4558.797375066206, "7": 4563.401291961782, "8": 4558.95049998071}, "receiver_prefill_ms": 165.02370801754296, "ttft_ms": 11.89695904031396, "decode_ms": 11.877209064550698}, "total_wall_ms": 39033.79162505735, "ttft_ms": 11.89695904031396, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | |
| 6594 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "52fa2b2c3cb580da7ec91eef", "attempt_id": "92f1081e2251", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:44.639515Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 462, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38844.63216701988, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715, "5": 4559.562999987975, "6": 4558.797375066206, "7": 4563.401291961782, "8": 4558.95049998071}, "receiver_prefill_ms": 185.40212500374764, "ttft_ms": 11.866374989040196, "decode_ms": 11.911208042874932}, "total_wall_ms": 39054.18004200328, "ttft_ms": 11.866374989040196, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6595 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "70862c8c72ebe95f2f2bb9b5", "attempt_id": "6e7c77d22f4b", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:44.864096Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 453, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38844.63216701988, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715, "5": 4559.562999987975, "6": 4558.797375066206, "7": 4563.401291961782, "8": 4558.95049998071}, "receiver_prefill_ms": 185.03620906267315, "ttft_ms": 11.9964579353109, "decode_ms": 12.023207964375615}, "total_wall_ms": 39054.06704195775, "ttft_ms": 11.9964579353109, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6596 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "2dc0a964239c683b3f179055", "attempt_id": "c4b0d24a0d0b", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:45.088682Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 463, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38844.63216701988, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715, "5": 4559.562999987975, "6": 4558.797375066206, "7": 4563.401291961782, "8": 4558.95049998071}, "receiver_prefill_ms": 185.9790829475969, "ttft_ms": 12.004542048089206, "decode_ms": 11.836834019050002}, "total_wall_ms": 39054.81691705063, "ttft_ms": 12.004542048089206, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6597 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "3caaad1c53a1ddb32a816a58", "attempt_id": "3a00a9188b29", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:45.313751Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 456, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38844.63216701988, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715, "5": 4559.562999987975, "6": 4558.797375066206, "7": 4563.401291961782, "8": 4558.95049998071}, "receiver_prefill_ms": 185.0465410389006, "ttft_ms": 11.896957992576063, "decode_ms": 82.89233292452991}, "total_wall_ms": 39124.85325103626, "ttft_ms": 11.896957992576063, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8066734", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "167c75fdd6a41fca64228797ab8f3a1a3f994475246df0bffb2e060d5d2e4ff0"} | |
| 6598 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "79fb8fd228a9c85c726bd42f", "attempt_id": "e7ec78e988b7", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:45.609438Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 453, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38844.63216701988, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715, "5": 4559.562999987975, "6": 4558.797375066206, "7": 4563.401291961782, "8": 4558.95049998071}, "receiver_prefill_ms": 184.29700005799532, "ttft_ms": 11.732916929759085, "decode_ms": 11.949750012718141}, "total_wall_ms": 39053.147459053434, "ttft_ms": 11.732916929759085, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6599 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c97d85eed8d58bde93d7c368", "attempt_id": "24ad152e9ec5", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:45.833559Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 457, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38844.63216701988, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715, "5": 4559.562999987975, "6": 4558.797375066206, "7": 4563.401291961782, "8": 4558.95049998071}, "receiver_prefill_ms": 185.73754199314862, "ttft_ms": 11.87799999024719, "decode_ms": 11.943457997404039}, "total_wall_ms": 39054.58787502721, "ttft_ms": 11.87799999024719, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6600 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "6b0507a68f2d9d20b2279c54", "attempt_id": "38e783ff4ab5", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:46.059629Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 458, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38844.63216701988, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715, "5": 4559.562999987975, "6": 4558.797375066206, "7": 4563.401291961782, "8": 4558.95049998071}, "receiver_prefill_ms": 185.37674995604903, "ttft_ms": 11.859874939545989, "decode_ms": 11.881249956786633}, "total_wall_ms": 39054.13695902098, "ttft_ms": 11.859874939545989, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6601 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ecc468121b857927f149d66b", "attempt_id": "7b3835396b72", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:53.231843Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6945.187625009567, "hops": {"1": 6945.187625009567}, "receiver_prefill_ms": 227.01366699766368, "ttft_ms": 11.890541994944215, "decode_ms": 12.150709051638842}, "total_wall_ms": 7196.774625102989, "ttft_ms": 11.890541994944215, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6602 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c9c81ead6074b873905fcace", "attempt_id": "36ba97098c36", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:53.499518Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6945.187625009567, "hops": {"1": 6945.187625009567}, "receiver_prefill_ms": 227.2832499584183, "ttft_ms": 11.905667022801936, "decode_ms": 12.08170794416219}, "total_wall_ms": 7196.945791016333, "ttft_ms": 11.905667022801936, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6603 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0aa9738e1cb9411ae4f12633", "attempt_id": "adf434ace87d", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:53.766828Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6945.187625009567, "hops": {"1": 6945.187625009567}, "receiver_prefill_ms": 227.04312507994473, "ttft_ms": 11.928042047657073, "decode_ms": 83.2612500526011}, "total_wall_ms": 7267.958375043236, "ttft_ms": 11.928042047657073, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "30.0224", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "e28a78bc4deb3cec8beab4bf5b87297d7cc55a3e6f839b43fe6408735d464923"} | |
| 6604 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b819f4cf4d70789765f56d45", "attempt_id": "72973140ba2c", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:54.104944Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6945.187625009567, "hops": {"1": 6945.187625009567}, "receiver_prefill_ms": 226.95950011257082, "ttft_ms": 12.000125017948449, "decode_ms": 11.916665942408144}, "total_wall_ms": 7196.552124922164, "ttft_ms": 12.000125017948449, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6605 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9aa49802748ba50ac7ef879f", "attempt_id": "ea79a43d161d", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:54.371379Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 601, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6945.187625009567, "hops": {"1": 6945.187625009567}, "receiver_prefill_ms": 227.11995895951986, "ttft_ms": 11.928292107768357, "decode_ms": 107.15870803687721}, "total_wall_ms": 7291.916416957974, "ttft_ms": 11.928292107768357, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,009,480", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "30b20d9aae4d7b0587edeefdc2a9a159f73faf6e2570f1d408a415fe92cbf45e"} | |
| 6606 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b4e0a18d8c2966c1ad66e40e", "attempt_id": "b38a9e749d7a", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:54.733269Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 605, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6945.187625009567, "hops": {"1": 6945.187625009567}, "receiver_prefill_ms": 227.19416697509587, "ttft_ms": 11.907875072211027, "decode_ms": 11.93504105322063}, "total_wall_ms": 7196.724709006958, "ttft_ms": 11.907875072211027, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6607 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a00451a766a29b7098803d89", "attempt_id": "3727adecc409", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:55.000408Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 594, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6945.187625009567, "hops": {"1": 6945.187625009567}, "receiver_prefill_ms": 226.95954202208668, "ttft_ms": 12.039124965667725, "decode_ms": 11.90358295571059}, "total_wall_ms": 7196.595625020564, "ttft_ms": 12.039124965667725, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | |
| 6608 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f2baa60c53536a3dd4482fbe", "attempt_id": "5121887d28f2", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:55.267121Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 596, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6945.187625009567, "hops": {"1": 6945.187625009567}, "receiver_prefill_ms": 227.23612503614277, "ttft_ms": 11.964207980781794, "decode_ms": 11.92641700617969}, "total_wall_ms": 7196.817999938503, "ttft_ms": 11.964207980781794, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | |
| 6609 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "3e2159de9daf206c7825ef1d", "attempt_id": "6c9a6172f2ee", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:55.533946Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 612, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6945.187625009567, "hops": {"1": 6945.187625009567}, "receiver_prefill_ms": 229.46875006891787, "ttft_ms": 11.937875067815185, "decode_ms": 11.968082981184125}, "total_wall_ms": 7199.072916992009, "ttft_ms": 11.937875067815185, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6610 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "1c2d6f113f606cf9fbcb401b", "attempt_id": "3b8cc8974e49", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:55.803170Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6945.187625009567, "hops": {"1": 6945.187625009567}, "receiver_prefill_ms": 227.52887499518692, "ttft_ms": 11.987083009444177, "decode_ms": 11.924542021006346}, "total_wall_ms": 7197.124334052205, "ttft_ms": 11.987083009444177, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6611 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "84e974276dc7ae1c7f8ac55b", "attempt_id": "0210cc9c3b1b", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:56.070518Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 613, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6945.187625009567, "hops": {"1": 6945.187625009567}, "receiver_prefill_ms": 229.18304102495313, "ttft_ms": 12.186208041384816, "decode_ms": 12.122917105443776}, "total_wall_ms": 7199.391000089236, "ttft_ms": 12.186208041384816, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6612 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "661a3cebc51120ec584eec23", "attempt_id": "9874aa566701", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:56.340077Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6945.187625009567, "hops": {"1": 6945.187625009567}, "receiver_prefill_ms": 226.54004103969783, "ttft_ms": 12.3287090100348, "decode_ms": 84.38154100440443}, "total_wall_ms": 7269.193916930817, "ttft_ms": 12.3287090100348, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2707654", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "7799e805760fa6568574360f61d4c7cc9e162842191ff434dfed71076922855e"} | |
| 6613 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "40b645465198bd7914f472e1", "attempt_id": "800fc667bc14", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:56.680556Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6945.187625009567, "hops": {"1": 6945.187625009567}, "receiver_prefill_ms": 227.1463330835104, "ttft_ms": 12.037250096909702, "decode_ms": 11.95787510368973}, "total_wall_ms": 7196.986290975474, "ttft_ms": 12.037250096909702, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6614 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4182d2221720c6ea031a231d", "attempt_id": "e07e62f59299", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:56.948105Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 607, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6945.187625009567, "hops": {"1": 6945.187625009567}, "receiver_prefill_ms": 227.4645830038935, "ttft_ms": 12.003249954432249, "decode_ms": 11.94899994879961}, "total_wall_ms": 7197.1197499660775, "ttft_ms": 12.003249954432249, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6615 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c7f5eccb5b99d80bd36304cc", "attempt_id": "26ab68fe59b4", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:57.215664Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 608, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6945.187625009567, "hops": {"1": 6945.187625009567}, "receiver_prefill_ms": 227.46837500017136, "ttft_ms": 11.944042053073645, "decode_ms": 11.833416996523738}, "total_wall_ms": 7196.95229199715, "ttft_ms": 11.944042053073645, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6616 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ddd0a2ed0dcb48c768ecfe32", "attempt_id": "4d72fc89187d", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:04.013453Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1498, "cache_tensor_bytes": null, "serialized_payload_bytes": 1498, "side_information_bytes": 0, "fetched_bytes": 1169, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13474.19674997218, "hops": {"1": 6945.187625009567, "2": 6529.009124962613}, "receiver_prefill_ms": 226.34804202243686, "ttft_ms": 12.367833056487143, "decode_ms": 12.113792006857693}, "total_wall_ms": 13725.749083911069, "ttft_ms": 12.367833056487143, "input_usage": {"lookups": 2}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dbc18f4d960624946c884bb20c9368119b30b62a2cad122ffe8ba81f0d70bc39", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6617 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9b17bc6001af4428d4595a97", "attempt_id": "1aafde050649", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:04.281307Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1498, "cache_tensor_bytes": null, "serialized_payload_bytes": 1498, "side_information_bytes": 0, "fetched_bytes": 1169, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13474.19674997218, "hops": {"1": 6945.187625009567, "2": 6529.009124962613}, "receiver_prefill_ms": 226.9915830111131, "ttft_ms": 11.986832949332893, "decode_ms": 11.93108398001641}, "total_wall_ms": 13725.823416025378, "ttft_ms": 11.986832949332893, "input_usage": {"lookups": 2}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dbc18f4d960624946c884bb20c9368119b30b62a2cad122ffe8ba81f0d70bc39", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6618 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ca1ccfe4498967618aac5e4c", "attempt_id": "65c3b66a4269", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:04.550550Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1498, "cache_tensor_bytes": null, "serialized_payload_bytes": 1498, "side_information_bytes": 0, "fetched_bytes": 1169, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13474.19674997218, "hops": {"1": 6945.187625009567, "2": 6529.009124962613}, "receiver_prefill_ms": 227.24337503314018, "ttft_ms": 12.113417033106089, "decode_ms": 83.23362492956221}, "total_wall_ms": 13797.474874998443, "ttft_ms": 12.113417033106089, "input_usage": {"lookups": 2}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "30.0224", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dbc18f4d960624946c884bb20c9368119b30b62a2cad122ffe8ba81f0d70bc39", "output_hash": "e28a78bc4deb3cec8beab4bf5b87297d7cc55a3e6f839b43fe6408735d464923"} | |
| 6619 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "1495cd4007f1a99adeea5c5c", "attempt_id": "bff779179295", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:04.890664Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1498, "cache_tensor_bytes": null, "serialized_payload_bytes": 1498, "side_information_bytes": 0, "fetched_bytes": 1169, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13474.19674997218, "hops": {"1": 6945.187625009567, "2": 6529.009124962613}, "receiver_prefill_ms": 226.6717499587685, "ttft_ms": 12.021500035189092, "decode_ms": 11.90883293747902}, "total_wall_ms": 13725.447041913867, "ttft_ms": 12.021500035189092, "input_usage": {"lookups": 2}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dbc18f4d960624946c884bb20c9368119b30b62a2cad122ffe8ba81f0d70bc39", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6620 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "82923a9b27c5c4f3b4d0441f", "attempt_id": "ddcb031505aa", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:05.158105Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 601, "message_tokens": 512, "message_utf8_bytes": 1498, "cache_tensor_bytes": null, "serialized_payload_bytes": 1498, "side_information_bytes": 0, "fetched_bytes": 1169, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13474.19674997218, "hops": {"1": 6945.187625009567, "2": 6529.009124962613}, "receiver_prefill_ms": 227.34483401291072, "ttft_ms": 11.980792041867971, "decode_ms": 106.91137495450675}, "total_wall_ms": 13821.044415934011, "ttft_ms": 11.980792041867971, "input_usage": {"lookups": 2}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,009,480", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dbc18f4d960624946c884bb20c9368119b30b62a2cad122ffe8ba81f0d70bc39", "output_hash": "30b20d9aae4d7b0587edeefdc2a9a159f73faf6e2570f1d408a415fe92cbf45e"} | |
| 6621 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "de38db94279fbc7af8908fe2", "attempt_id": "5add0cc8521f", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:05.520929Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 605, "message_tokens": 512, "message_utf8_bytes": 1498, "cache_tensor_bytes": null, "serialized_payload_bytes": 1498, "side_information_bytes": 0, "fetched_bytes": 1169, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13474.19674997218, "hops": {"1": 6945.187625009567, "2": 6529.009124962613}, "receiver_prefill_ms": 227.1708749467507, "ttft_ms": 11.961457901634276, "decode_ms": 11.95499999448657}, "total_wall_ms": 13725.830999901518, "ttft_ms": 11.961457901634276, "input_usage": {"lookups": 2}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dbc18f4d960624946c884bb20c9368119b30b62a2cad122ffe8ba81f0d70bc39", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6622 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "1649ac1afc6a9df21ecf9663", "attempt_id": "7aec67e491fc", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:05.788330Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 594, "message_tokens": 512, "message_utf8_bytes": 1498, "cache_tensor_bytes": null, "serialized_payload_bytes": 1498, "side_information_bytes": 0, "fetched_bytes": 1169, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13474.19674997218, "hops": {"1": 6945.187625009567, "2": 6529.009124962613}, "receiver_prefill_ms": 226.8016659654677, "ttft_ms": 12.11179094389081, "decode_ms": 11.98212499730289}, "total_wall_ms": 13725.765916984528, "ttft_ms": 12.11179094389081, "input_usage": {"lookups": 2}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dbc18f4d960624946c884bb20c9368119b30b62a2cad122ffe8ba81f0d70bc39", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | |
| 6623 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "699107816d669f7e0a3e23bf", "attempt_id": "cf01b5e3dfa8", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:06.055667Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 596, "message_tokens": 512, "message_utf8_bytes": 1498, "cache_tensor_bytes": null, "serialized_payload_bytes": 1498, "side_information_bytes": 0, "fetched_bytes": 1169, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13474.19674997218, "hops": {"1": 6945.187625009567, "2": 6529.009124962613}, "receiver_prefill_ms": 227.28991694748402, "ttft_ms": 11.97016704827547, "decode_ms": 11.920665972866118}, "total_wall_ms": 13725.915541988797, "ttft_ms": 11.97016704827547, "input_usage": {"lookups": 2}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dbc18f4d960624946c884bb20c9368119b30b62a2cad122ffe8ba81f0d70bc39", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | |
| 6624 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b0a2af98e6361b232020b4c4", "attempt_id": "46a607b531bf", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:06.323338Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 612, "message_tokens": 512, "message_utf8_bytes": 1498, "cache_tensor_bytes": null, "serialized_payload_bytes": 1498, "side_information_bytes": 0, "fetched_bytes": 1169, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13474.19674997218, "hops": {"1": 6945.187625009567, "2": 6529.009124962613}, "receiver_prefill_ms": 228.967540897429, "ttft_ms": 12.09699991159141, "decode_ms": 11.913041002117097}, "total_wall_ms": 13727.846957975999, "ttft_ms": 12.09699991159141, "input_usage": {"lookups": 2}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dbc18f4d960624946c884bb20c9368119b30b62a2cad122ffe8ba81f0d70bc39", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6625 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "697645ece476866d837fffc0", "attempt_id": "99cace8fee14", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:06.592848Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1498, "cache_tensor_bytes": null, "serialized_payload_bytes": 1498, "side_information_bytes": 0, "fetched_bytes": 1169, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13474.19674997218, "hops": {"1": 6945.187625009567, "2": 6529.009124962613}, "receiver_prefill_ms": 227.57745801936835, "ttft_ms": 11.894499999471009, "decode_ms": 11.974791996181011}, "total_wall_ms": 13726.162582985125, "ttft_ms": 11.894499999471009, "input_usage": {"lookups": 2}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dbc18f4d960624946c884bb20c9368119b30b62a2cad122ffe8ba81f0d70bc39", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6626 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f5ac5245051f19929cba1156", "attempt_id": "4b7586d36fe7", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:06.860923Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 613, "message_tokens": 512, "message_utf8_bytes": 1498, "cache_tensor_bytes": null, "serialized_payload_bytes": 1498, "side_information_bytes": 0, "fetched_bytes": 1169, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13474.19674997218, "hops": {"1": 6945.187625009567, "2": 6529.009124962613}, "receiver_prefill_ms": 229.3671660590917, "ttft_ms": 12.044333037920296, "decode_ms": 11.911208974197507}, "total_wall_ms": 13728.087250026874, "ttft_ms": 12.044333037920296, "input_usage": {"lookups": 2}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dbc18f4d960624946c884bb20c9368119b30b62a2cad122ffe8ba81f0d70bc39", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6627 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "77d547e0da4a676a516b25c6", "attempt_id": "51a62505c708", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:07.130124Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1498, "cache_tensor_bytes": null, "serialized_payload_bytes": 1498, "side_information_bytes": 0, "fetched_bytes": 1169, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13474.19674997218, "hops": {"1": 6945.187625009567, "2": 6529.009124962613}, "receiver_prefill_ms": 227.38770802970976, "ttft_ms": 11.881542042829096, "decode_ms": 118.59470896888524}, "total_wall_ms": 13832.722624996677, "ttft_ms": 11.881542042829096, "input_usage": {"lookups": 2}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "27,310,344", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dbc18f4d960624946c884bb20c9368119b30b62a2cad122ffe8ba81f0d70bc39", "output_hash": "57d43335b2f7697d49fa5c54ca28131a174ade7ed50cefb8f9e04bda80bbc15f"} | |
| 6628 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "edfe6182ed4c363a784dd7c1", "attempt_id": "65819bfa9800", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:07.504845Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1498, "cache_tensor_bytes": null, "serialized_payload_bytes": 1498, "side_information_bytes": 0, "fetched_bytes": 1169, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13474.19674997218, "hops": {"1": 6945.187625009567, "2": 6529.009124962613}, "receiver_prefill_ms": 226.63245897274464, "ttft_ms": 12.079125037416816, "decode_ms": 11.959875002503395}, "total_wall_ms": 13725.523082888685, "ttft_ms": 12.079125037416816, "input_usage": {"lookups": 2}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dbc18f4d960624946c884bb20c9368119b30b62a2cad122ffe8ba81f0d70bc39", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6629 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d36780001f0d8386b12bcfac", "attempt_id": "e8e4161722b4", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:07.772870Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 607, "message_tokens": 512, "message_utf8_bytes": 1498, "cache_tensor_bytes": null, "serialized_payload_bytes": 1498, "side_information_bytes": 0, "fetched_bytes": 1169, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13474.19674997218, "hops": {"1": 6945.187625009567, "2": 6529.009124962613}, "receiver_prefill_ms": 226.955582969822, "ttft_ms": 12.005541939288378, "decode_ms": 11.948833940550685}, "total_wall_ms": 13725.715999957174, "ttft_ms": 12.005541939288378, "input_usage": {"lookups": 2}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dbc18f4d960624946c884bb20c9368119b30b62a2cad122ffe8ba81f0d70bc39", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6630 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0a217c7fd0a62d0e3230eb17", "attempt_id": "c7eec7c6324c", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:08.040485Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 608, "message_tokens": 512, "message_utf8_bytes": 1498, "cache_tensor_bytes": null, "serialized_payload_bytes": 1498, "side_information_bytes": 0, "fetched_bytes": 1169, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13474.19674997218, "hops": {"1": 6945.187625009567, "2": 6529.009124962613}, "receiver_prefill_ms": 226.89295804593712, "ttft_ms": 11.957416078075767, "decode_ms": 12.158999918028712}, "total_wall_ms": 13725.748124998063, "ttft_ms": 11.957416078075767, "input_usage": {"lookups": 2}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dbc18f4d960624946c884bb20c9368119b30b62a2cad122ffe8ba81f0d70bc39", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6631 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "379d5b5538ae30643f5249ce", "attempt_id": "4e381c78dd68", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:20.167322Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 545, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 3507, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25330.884958035313, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664}, "receiver_prefill_ms": 208.06799991987646, "ttft_ms": 11.886875028721988, "decode_ms": 11.92337495740503}, "total_wall_ms": 25563.275250140578, "ttft_ms": 11.886875028721988, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6632 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "2c7b1e8d752a7e243d1cff05", "attempt_id": "824e30cca4ae", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:20.416122Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 550, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 3507, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25330.884958035313, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664}, "receiver_prefill_ms": 210.17608302645385, "ttft_ms": 11.901749996468425, "decode_ms": 12.00404204428196}, "total_wall_ms": 25565.47687505372, "ttft_ms": 11.901749996468425, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6633 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "6812f7a2ba1cd68f1088eebc", "attempt_id": "74b109fd16e8", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:20.666282Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 550, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 3507, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25330.884958035313, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664}, "receiver_prefill_ms": 210.53391590248793, "ttft_ms": 11.850791983306408, "decode_ms": 82.68633403349668}, "total_wall_ms": 25636.444958043285, "ttft_ms": 11.850791983306408, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "30.0224", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "e28a78bc4deb3cec8beab4bf5b87297d7cc55a3e6f839b43fe6408735d464923"} | |
| 6634 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "dd5d7c7d7fad46dc6f565997", "attempt_id": "7839c04733a4", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:20.986940Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 545, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 3507, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25330.884958035313, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664}, "receiver_prefill_ms": 208.44499999657273, "ttft_ms": 11.90079189836979, "decode_ms": 11.803834000602365}, "total_wall_ms": 25563.497915980406, "ttft_ms": 11.90079189836979, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6635 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4904ba7a72aa51f181f35b71", "attempt_id": "f3940cc5f46a", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:21.234778Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 551, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 3507, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25330.884958035313, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664}, "receiver_prefill_ms": 210.2336250245571, "ttft_ms": 11.869499925523996, "decode_ms": 83.0089170485735}, "total_wall_ms": 25636.500083026476, "ttft_ms": 11.869499925523996, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6009480", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "925ebdb42a0311d11ea73517fd780f133bed1e6fad2f9f6d66408fe5dba57a45"} | |
| 6636 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7aff21c6616007f66536f0bc", "attempt_id": "95fa376ca579", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:21.555236Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 555, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 3507, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25330.884958035313, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664}, "receiver_prefill_ms": 210.08454205002636, "ttft_ms": 12.00154097750783, "decode_ms": 11.829583090730011}, "total_wall_ms": 25565.407915972173, "ttft_ms": 12.00154097750783, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6637 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "fbe8fa88274efe34defa866d", "attempt_id": "c91fc282df52", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:21.804851Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 544, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 3507, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25330.884958035313, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664}, "receiver_prefill_ms": 208.07570801116526, "ttft_ms": 11.908499989658594, "decode_ms": 11.832666001282632}, "total_wall_ms": 25563.19179199636, "ttft_ms": 11.908499989658594, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | |
| 6638 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f5a9c19b242f372562c2c431", "attempt_id": "88073ca7b4d6", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:22.053383Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 546, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 3507, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25330.884958035313, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664}, "receiver_prefill_ms": 209.97550000902265, "ttft_ms": 11.934541980735958, "decode_ms": 11.87483302783221}, "total_wall_ms": 25565.17512514256, "ttft_ms": 11.934541980735958, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | |
| 6639 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "96fd33520dbff2c8001b3994", "attempt_id": "a8507bd06d42", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:22.303034Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 562, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 3507, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25330.884958035313, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664}, "receiver_prefill_ms": 210.991624975577, "ttft_ms": 11.858333018608391, "decode_ms": 11.896957992576063}, "total_wall_ms": 25566.133375046775, "ttft_ms": 11.858333018608391, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6640 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c23ef4c124ac921da98151db", "attempt_id": "536dd7bb37ab", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:22.553423Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 553, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 3507, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25330.884958035313, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664}, "receiver_prefill_ms": 210.20912495441735, "ttft_ms": 11.930332984775305, "decode_ms": 11.827250011265278}, "total_wall_ms": 25565.332373953424, "ttft_ms": 11.930332984775305, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6641 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "36ba732ea4cfc41cc1d732ce", "attempt_id": "1e5a75f88d73", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:22.803404Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 563, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 3507, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25330.884958035313, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664}, "receiver_prefill_ms": 210.91000002343208, "ttft_ms": 11.837874888442457, "decode_ms": 71.11466606147587}, "total_wall_ms": 25625.217791064642, "ttft_ms": 11.837874888442457, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Quilun-16", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "34a7c0e11c93ba75eb4b20d3d3f5303b417856d89a232e8b16fef75c4336afc6"} | |
| 6642 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f0b5796cbe429684200f5e2e", "attempt_id": "7371af8583c7", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:23.113146Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 556, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 3507, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25330.884958035313, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664}, "receiver_prefill_ms": 210.468832985498, "ttft_ms": 11.858290992677212, "decode_ms": 118.48804203327745}, "total_wall_ms": 25672.169915982522, "ttft_ms": 11.858290992677212, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "37,154,259", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "475e1c30b81f429f1ab8d86eb02313598a196f4663b8300f83f9721827c72fa2"} | |
| 6643 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9711e0131a0cd3d701c0574b", "attempt_id": "7b1bf9d26ee2", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:23.469497Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 553, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 3507, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25330.884958035313, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664}, "receiver_prefill_ms": 210.56908403988928, "ttft_ms": 11.872458970174193, "decode_ms": 11.849624919705093}, "total_wall_ms": 25565.627333009616, "ttft_ms": 11.872458970174193, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6644 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d0b7c8d4571db28f7ac5b1e1", "attempt_id": "f50266f7a39b", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:23.719579Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 557, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 3507, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25330.884958035313, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664}, "receiver_prefill_ms": 210.87249997071922, "ttft_ms": 11.962375021539629, "decode_ms": 11.809041956439614}, "total_wall_ms": 25565.994290984236, "ttft_ms": 11.962375021539629, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6645 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "adb01e79b0bbb1677e43af85", "attempt_id": "bf93f950cae7", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:23.970052Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 558, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 3507, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25330.884958035313, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664}, "receiver_prefill_ms": 210.50145791377872, "ttft_ms": 11.901709018275142, "decode_ms": 11.903250007890165}, "total_wall_ms": 25565.673999954015, "ttft_ms": 11.901709018275142, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6646 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ea9d7975f67b5aeb7c411aa4", "attempt_id": "63f6e7b49bf5", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:47.857837Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 545, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 8183, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 48962.82533311751, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664, "5": 5908.367124968208, "6": 5911.119500058703, "7": 5908.995958045125, "8": 5903.457792010158}, "receiver_prefill_ms": 208.17083399742842, "ttft_ms": 11.87329099047929, "decode_ms": 11.856459081172943}, "total_wall_ms": 49195.238958112895, "ttft_ms": 11.87329099047929, "input_usage": {"lookups": 14}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6647 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4a6ccde7d05e2f611db92b53", "attempt_id": "a67b54cc6126", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:48.106543Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 550, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 8183, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 48962.82533311751, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664, "5": 5908.367124968208, "6": 5911.119500058703, "7": 5908.995958045125, "8": 5903.457792010158}, "receiver_prefill_ms": 210.02850006334484, "ttft_ms": 11.856041965074837, "decode_ms": 11.861832928843796}, "total_wall_ms": 49197.0619171625, "ttft_ms": 11.856041965074837, "input_usage": {"lookups": 14}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6648 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "07212d7317ff3732c632195e", "attempt_id": "4fa869a32a56", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:48.356141Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 550, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 8183, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 48962.82533311751, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664, "5": 5908.367124968208, "6": 5911.119500058703, "7": 5908.995958045125, "8": 5903.457792010158}, "receiver_prefill_ms": 209.67208303045481, "ttft_ms": 12.14137498755008, "decode_ms": 82.86954194772989}, "total_wall_ms": 49268.13470805064, "ttft_ms": 12.14137498755008, "input_usage": {"lookups": 14}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "30.0224", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "e28a78bc4deb3cec8beab4bf5b87297d7cc55a3e6f839b43fe6408735d464923"} | |
| 6649 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "36371940b36eea642b4e07dc", "attempt_id": "6cfe80fcc392", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:48.676719Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 545, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 8183, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 48962.82533311751, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664, "5": 5908.367124968208, "6": 5911.119500058703, "7": 5908.995958045125, "8": 5903.457792010158}, "receiver_prefill_ms": 208.0312919570133, "ttft_ms": 11.740374960936606, "decode_ms": 11.79654209408909}, "total_wall_ms": 49194.9811251834, "ttft_ms": 11.740374960936606, "input_usage": {"lookups": 14}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6650 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f8745caef4dfc82a81e2f64d", "attempt_id": "0604157bcc5a", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:48.924806Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 551, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 8183, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 48962.82533311751, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664, "5": 5908.367124968208, "6": 5911.119500058703, "7": 5908.995958045125, "8": 5903.457792010158}, "receiver_prefill_ms": 209.74558300804347, "ttft_ms": 12.021249975077808, "decode_ms": 83.20454100612551}, "total_wall_ms": 49268.38666712865, "ttft_ms": 12.021249975077808, "input_usage": {"lookups": 14}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6009480", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "925ebdb42a0311d11ea73517fd780f133bed1e6fad2f9f6d66408fe5dba57a45"} | |
| 6651 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7a59db27d10289109f0328a0", "attempt_id": "88fa2190d8c9", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:49.247229Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 555, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 8183, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 48962.82533311751, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664, "5": 5908.367124968208, "6": 5911.119500058703, "7": 5908.995958045125, "8": 5903.457792010158}, "receiver_prefill_ms": 210.0943330442533, "ttft_ms": 12.061125016771257, "decode_ms": 11.999916983768344}, "total_wall_ms": 49197.596250101924, "ttft_ms": 12.061125016771257, "input_usage": {"lookups": 14}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6652 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ef45120307fc2266b11d8af7", "attempt_id": "825a9c93c631", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:49.498147Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 544, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 8183, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 48962.82533311751, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664, "5": 5908.367124968208, "6": 5911.119500058703, "7": 5908.995958045125, "8": 5903.457792010158}, "receiver_prefill_ms": 208.67200009524822, "ttft_ms": 11.841083061881363, "decode_ms": 11.896749958395958}, "total_wall_ms": 49195.72095805779, "ttft_ms": 11.841083061881363, "input_usage": {"lookups": 14}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | |
| 6653 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c42dad7e95de16e07f29fb97", "attempt_id": "40addd9b02ed", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:49.746514Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 546, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 8183, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 48962.82533311751, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664, "5": 5908.367124968208, "6": 5911.119500058703, "7": 5908.995958045125, "8": 5903.457792010158}, "receiver_prefill_ms": 209.4325409270823, "ttft_ms": 11.94883300922811, "decode_ms": 11.900707962922752}, "total_wall_ms": 49196.7768331524, "ttft_ms": 11.94883300922811, "input_usage": {"lookups": 14}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | |
| 6654 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7f198d3f2f095fad3afbaf7f", "attempt_id": "cab9b981316d", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:49.995401Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 562, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 8183, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 48962.82533311751, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664, "5": 5908.367124968208, "6": 5911.119500058703, "7": 5908.995958045125, "8": 5903.457792010158}, "receiver_prefill_ms": 210.71041701361537, "ttft_ms": 11.958374991081655, "decode_ms": 11.919458978809416}, "total_wall_ms": 49198.026416124776, "ttft_ms": 11.958374991081655, "input_usage": {"lookups": 14}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6655 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5d4d9d8d1c6fd7c1ad0c4ed9", "attempt_id": "2f9274536f77", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:50.247543Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 553, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 8183, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 48962.82533311751, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664, "5": 5908.367124968208, "6": 5911.119500058703, "7": 5908.995958045125, "8": 5903.457792010158}, "receiver_prefill_ms": 210.1943331072107, "ttft_ms": 11.87558297533542, "decode_ms": 11.915415991097689}, "total_wall_ms": 49197.29508308228, "ttft_ms": 11.87558297533542, "input_usage": {"lookups": 14}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6656 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "df9b49b6ec627d80b0d980e4", "attempt_id": "47faad5bae03", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:50.497767Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 563, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 8183, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 48962.82533311751, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664, "5": 5908.367124968208, "6": 5911.119500058703, "7": 5908.995958045125, "8": 5903.457792010158}, "receiver_prefill_ms": 210.931958979927, "ttft_ms": 11.847249930724502, "decode_ms": 71.27329206559807}, "total_wall_ms": 49257.371041108854, "ttft_ms": 11.847249930724502, "input_usage": {"lookups": 14}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Quilun-16", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "34a7c0e11c93ba75eb4b20d3d3f5303b417856d89a232e8b16fef75c4336afc6"} | |
| 6657 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0745a7b15a0f41255c0e8386", "attempt_id": "a745c3d814c7", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:50.807671Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 556, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 8183, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 48962.82533311751, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664, "5": 5908.367124968208, "6": 5911.119500058703, "7": 5908.995958045125, "8": 5903.457792010158}, "receiver_prefill_ms": 210.0283340550959, "ttft_ms": 11.9330829475075, "decode_ms": 82.78916694689542}, "total_wall_ms": 49268.15895806067, "ttft_ms": 11.9330829475075, "input_usage": {"lookups": 14}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "3354484", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "5bf31ed3819d2b67352d6e22ea7f16de2ebd589c8281b4393305795b432156e3"} | |
| 6658 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7c25e5cad91c4ab6c6c925d0", "attempt_id": "b401e3571008", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:51.128413Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 553, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 8183, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 48962.82533311751, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664, "5": 5908.367124968208, "6": 5911.119500058703, "7": 5908.995958045125, "8": 5903.457792010158}, "receiver_prefill_ms": 210.57270793244243, "ttft_ms": 11.816957965493202, "decode_ms": 11.756874970160425}, "total_wall_ms": 49197.45633320417, "ttft_ms": 11.816957965493202, "input_usage": {"lookups": 14}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6659 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "20b59930dcbddc00065ce674", "attempt_id": "3a1820a0b83c", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:51.378907Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 557, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 8183, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 48962.82533311751, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664, "5": 5908.367124968208, "6": 5911.119500058703, "7": 5908.995958045125, "8": 5903.457792010158}, "receiver_prefill_ms": 210.54037509020418, "ttft_ms": 11.821750085800886, "decode_ms": 11.873625102452934}, "total_wall_ms": 49197.53104215488, "ttft_ms": 11.821750085800886, "input_usage": {"lookups": 14}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6660 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c558c630043a4780c8416796", "attempt_id": "8b2e9c1fd8ce", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:51.628891Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 558, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 8183, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 48962.82533311751, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664, "5": 5908.367124968208, "6": 5911.119500058703, "7": 5908.995958045125, "8": 5903.457792010158}, "receiver_prefill_ms": 210.47225000802428, "ttft_ms": 11.869207955896854, "decode_ms": 11.876833974383771}, "total_wall_ms": 49197.51333317254, "ttft_ms": 11.869207955896854, "input_usage": {"lookups": 14}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6661 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "03c853b60429fefd8c52404b", "attempt_id": "f3083fa0756a", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:58.819090Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 440, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6938.470332999714, "hops": {"1": 6938.470332999714}, "receiver_prefill_ms": 164.517541998066, "ttft_ms": 11.817041086032987, "decode_ms": 11.78620895370841}, "total_wall_ms": 7127.00237496756, "ttft_ms": 11.817041086032987, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6662 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "659546d3c6c8e91434e91120", "attempt_id": "8693fef81a0f", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:59.024065Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 445, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6938.470332999714, "hops": {"1": 6938.470332999714}, "receiver_prefill_ms": 165.25012499187142, "ttft_ms": 11.77537499461323, "decode_ms": 129.4018329354003}, "total_wall_ms": 7245.301707996987, "ttft_ms": 11.77537499461323, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 568-G in Mont-Laurier", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.5}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "98e007faa5a10742ad74f2778a64e3ea0d6b72bec1c0392200d475073d7bf082"} | |
| 6663 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "bc2dfe32753ea89d44e1cfdb", "attempt_id": "decac8927b3c", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:59.345970Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 445, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6938.470332999714, "hops": {"1": 6938.470332999714}, "receiver_prefill_ms": 163.9936660649255, "ttft_ms": 12.05391704570502, "decode_ms": 11.81683293543756}, "total_wall_ms": 7126.827500062063, "ttft_ms": 12.05391704570502, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6664 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "004f79a48f8bb5ef4b629de6", "attempt_id": "d3f7582f8d23", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:59.549814Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 440, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6938.470332999714, "hops": {"1": 6938.470332999714}, "receiver_prefill_ms": 164.43112504202873, "ttft_ms": 11.818542028777301, "decode_ms": 11.775457998737693}, "total_wall_ms": 7126.878416980617, "ttft_ms": 11.818542028777301, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6665 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ef81e1358ba9280b1dea01fd", "attempt_id": "8f1be55433c9", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:59.753823Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 446, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6938.470332999714, "hops": {"1": 6938.470332999714}, "receiver_prefill_ms": 165.45770806260407, "ttft_ms": 11.775291990488768, "decode_ms": 11.769125005230308}, "total_wall_ms": 7127.935083000921, "ttft_ms": 11.775291990488768, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6666 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "be1e71ee029391c89409175a", "attempt_id": "3253db3564f0", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:59.958096Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 450, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6938.470332999714, "hops": {"1": 6938.470332999714}, "receiver_prefill_ms": 184.9020830122754, "ttft_ms": 11.921457946300507, "decode_ms": 11.848208028823137}, "total_wall_ms": 7147.635500063188, "ttft_ms": 11.921457946300507, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6667 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "67a19ff324af232bb43044d8", "attempt_id": "717ea252564c", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:00.183591Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 439, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6938.470332999714, "hops": {"1": 6938.470332999714}, "receiver_prefill_ms": 164.2949590459466, "ttft_ms": 11.728540994226933, "decode_ms": 11.765125091187656}, "total_wall_ms": 7126.6367910429835, "ttft_ms": 11.728540994226933, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | |
| 6668 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0b75b646c7ae9de3e5b1d391", "attempt_id": "1e949e438fa2", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:00.387686Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 441, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6938.470332999714, "hops": {"1": 6938.470332999714}, "receiver_prefill_ms": 164.01404200587422, "ttft_ms": 11.757125030271709, "decode_ms": 12.009124970063567}, "total_wall_ms": 7126.621874049306, "ttft_ms": 11.757125030271709, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | |
| 6669 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9764778f1bc324f5bda62993", "attempt_id": "b6d39c828995", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:00.590799Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 457, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6938.470332999714, "hops": {"1": 6938.470332999714}, "receiver_prefill_ms": 185.68837502971292, "ttft_ms": 11.77166705019772, "decode_ms": 11.99179096147418}, "total_wall_ms": 7148.304958012886, "ttft_ms": 11.77166705019772, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6670 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a97c4ba1dcaebb932af7be3a", "attempt_id": "c40ddb710540", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:00.815836Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 448, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6938.470332999714, "hops": {"1": 6938.470332999714}, "receiver_prefill_ms": 165.8008329104632, "ttft_ms": 11.785916984081268, "decode_ms": 82.51291699707508}, "total_wall_ms": 7198.933623963967, "ttft_ms": 11.785916984081268, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "9134435", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "f7384892cb4f9a38f6115f91da5fec3f0d7e24e47877737b0f34e2b4a6af7d5a"} | |
| 6671 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "fffda64207b098973f304634", "attempt_id": "67c02ab41338", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:01.091262Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 458, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6938.470332999714, "hops": {"1": 6938.470332999714}, "receiver_prefill_ms": 185.10133295785636, "ttft_ms": 11.834957986138761, "decode_ms": 11.790541000664234}, "total_wall_ms": 7147.569333086722, "ttft_ms": 11.834957986138761, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6672 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e91412e5d9c632cab392f9a9", "attempt_id": "29e2b1f997f6", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:01.315207Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 451, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6938.470332999714, "hops": {"1": 6938.470332999714}, "receiver_prefill_ms": 185.14366704039276, "ttft_ms": 11.891166912391782, "decode_ms": 82.28991692885756}, "total_wall_ms": 7218.1846658932045, "ttft_ms": 11.891166912391782, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8066734", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "167c75fdd6a41fca64228797ab8f3a1a3f994475246df0bffb2e060d5d2e4ff0"} | |
| 6673 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "febf4ecb58a79ecb171e348b", "attempt_id": "ee03eea820ea", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:01.610181Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 448, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6938.470332999714, "hops": {"1": 6938.470332999714}, "receiver_prefill_ms": 165.15287500806153, "ttft_ms": 11.796292033977807, "decode_ms": 11.700666975229979}, "total_wall_ms": 7127.4879990378395, "ttft_ms": 11.796292033977807, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6674 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "350140ff476429db88de04c7", "attempt_id": "23321660e55c", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:01.814094Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 452, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6938.470332999714, "hops": {"1": 6938.470332999714}, "receiver_prefill_ms": 184.93266601581126, "ttft_ms": 11.85204100329429, "decode_ms": 11.755957966670394}, "total_wall_ms": 7147.374207968824, "ttft_ms": 11.85204100329429, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6675 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ac0be4f793cfcc69f6eb9d91", "attempt_id": "560c357d500b", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:02.037931Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 453, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6938.470332999714, "hops": {"1": 6938.470332999714}, "receiver_prefill_ms": 185.35120808519423, "ttft_ms": 11.818500002846122, "decode_ms": 11.868750094436109}, "total_wall_ms": 7147.877166979015, "ttft_ms": 11.818500002846122, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6676 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "424b07858953312ca1a64299", "attempt_id": "9ee8b429de25", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:06.965140Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 449, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 582, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11639.434623997658, "hops": {"1": 6938.470332999714, "2": 4700.964290997945}, "receiver_prefill_ms": 164.64054200332612, "ttft_ms": 11.968332924880087, "decode_ms": 117.66037496272475}, "total_wall_ms": 11934.194498928264, "ttft_ms": 11.968332924880087, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "BU-55G-3254", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "98227e32c2121a7856e6d2b32b74598ce6f4183c2ec3eec7ce4b9b0b3f66b98b"} | |
| 6677 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "90531576983c730896a68ce8", "attempt_id": "70f45377c44e", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:07.277076Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 454, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 582, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11639.434623997658, "hops": {"1": 6938.470332999714, "2": 4700.964290997945}, "receiver_prefill_ms": 185.25383400265127, "ttft_ms": 11.858458979986608, "decode_ms": 129.4203749857843}, "total_wall_ms": 11966.401290032081, "ttft_ms": 11.858458979986608, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 568-G in Mont-Laurier", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.5}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "98e007faa5a10742ad74f2778a64e3ea0d6b72bec1c0392200d475073d7bf082"} | |
| 6678 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "751f2ecaa99dfeda54c9e58c", "attempt_id": "ce660dedb179", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:07.619905Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 454, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 582, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11639.434623997658, "hops": {"1": 6938.470332999714, "2": 4700.964290997945}, "receiver_prefill_ms": 185.57770806364715, "ttft_ms": 11.873041046783328, "decode_ms": 11.823041015304625}, "total_wall_ms": 11849.075665930286, "ttft_ms": 11.873041046783328, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6679 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ebaec1a7648c85c400d6e572", "attempt_id": "40f1875644a1", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:07.844850Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 449, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 582, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11639.434623997658, "hops": {"1": 6938.470332999714, "2": 4700.964290997945}, "receiver_prefill_ms": 164.29262491874397, "ttft_ms": 11.786874965764582, "decode_ms": 11.796750011853874}, "total_wall_ms": 11827.676290995441, "ttft_ms": 11.786874965764582, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6680 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "81891eb09c27b34cffe6a7a9", "attempt_id": "6add956523f0", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:08.048199Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 455, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 582, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11639.434623997658, "hops": {"1": 6938.470332999714, "2": 4700.964290997945}, "receiver_prefill_ms": 185.66891690716147, "ttft_ms": 11.844040942378342, "decode_ms": 11.776958010159433}, "total_wall_ms": 11849.090290954337, "ttft_ms": 11.844040942378342, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6681 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c6169ee6a443339438e23875", "attempt_id": "a57ee2e3f66d", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:08.272554Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 459, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 582, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11639.434623997658, "hops": {"1": 6938.470332999714, "2": 4700.964290997945}, "receiver_prefill_ms": 185.2607079781592, "ttft_ms": 12.044250033795834, "decode_ms": 11.8002500385046}, "total_wall_ms": 11849.064249079674, "ttft_ms": 12.044250033795834, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6682 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f0aa0f2ff17d00ee0b5b8816", "attempt_id": "b609613785cd", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:08.497533Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 448, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 582, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11639.434623997658, "hops": {"1": 6938.470332999714, "2": 4700.964290997945}, "receiver_prefill_ms": 165.24495801422745, "ttft_ms": 11.977125075645745, "decode_ms": 11.791958939284086}, "total_wall_ms": 11828.95158289466, "ttft_ms": 11.977125075645745, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | |
| 6683 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e0899cf79f0f7cd52286d1f5", "attempt_id": "cc06d91f470c", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:08.703516Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 450, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 582, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11639.434623997658, "hops": {"1": 6938.470332999714, "2": 4700.964290997945}, "receiver_prefill_ms": 184.92145801428705, "ttft_ms": 11.808958952315152, "decode_ms": 11.843875050544739}, "total_wall_ms": 11848.410123959184, "ttft_ms": 11.808958952315152, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | |
| 6684 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4afaca2b78a5a2420a6246ac", "attempt_id": "ed1e17cb3579", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:08.928038Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 466, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 582, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11639.434623997658, "hops": {"1": 6938.470332999714, "2": 4700.964290997945}, "receiver_prefill_ms": 185.9617909649387, "ttft_ms": 11.853833915665746, "decode_ms": 11.820040992461145}, "total_wall_ms": 11849.50516500976, "ttft_ms": 11.853833915665746, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6685 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "45e5d22c0f88b0f7dafad5f5", "attempt_id": "aa199fc05bbc", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:09.153414Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 457, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 582, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11639.434623997658, "hops": {"1": 6938.470332999714, "2": 4700.964290997945}, "receiver_prefill_ms": 185.0972919492051, "ttft_ms": 11.72175002284348, "decode_ms": 11.691333027556539}, "total_wall_ms": 11848.329706932418, "ttft_ms": 11.72175002284348, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6686 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ad152b0fbec499eb226af5ba", "attempt_id": "d80390d54ed3", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:09.377257Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 467, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 582, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11639.434623997658, "hops": {"1": 6938.470332999714, "2": 4700.964290997945}, "receiver_prefill_ms": 185.96912501379848, "ttft_ms": 11.843541986308992, "decode_ms": 11.839832994155586}, "total_wall_ms": 11849.508290062658, "ttft_ms": 11.843541986308992, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6687 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ea7dfe800281f7663543ee0e", "attempt_id": "e222ce7868c4", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:09.602842Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 460, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 582, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11639.434623997658, "hops": {"1": 6938.470332999714, "2": 4700.964290997945}, "receiver_prefill_ms": 186.07433408033103, "ttft_ms": 11.826290981844068, "decode_ms": 82.48495811130852}, "total_wall_ms": 11920.229956973344, "ttft_ms": 11.826290981844068, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8066734", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "167c75fdd6a41fca64228797ab8f3a1a3f994475246df0bffb2e060d5d2e4ff0"} | |
| 6688 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "949a8dab89a6758d64b67831", "attempt_id": "58d5af2be7cb", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:09.898871Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 457, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 582, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11639.434623997658, "hops": {"1": 6938.470332999714, "2": 4700.964290997945}, "receiver_prefill_ms": 185.84016605746, "ttft_ms": 11.794457910582423, "decode_ms": 11.997958994470537}, "total_wall_ms": 11849.45574903395, "ttft_ms": 11.794457910582423, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6689 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "bc008dc614648e16e1588613", "attempt_id": "92f96266df72", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:10.124159Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 461, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 582, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11639.434623997658, "hops": {"1": 6938.470332999714, "2": 4700.964290997945}, "receiver_prefill_ms": 185.82870799582452, "ttft_ms": 11.764083988964558, "decode_ms": 11.943458928726614}, "total_wall_ms": 11849.347415962256, "ttft_ms": 11.764083988964558, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6690 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "16af9a53046028a4496ab413", "attempt_id": "28f6de5fcc12", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:10.349260Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 462, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 582, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11639.434623997658, "hops": {"1": 6938.470332999714, "2": 4700.964290997945}, "receiver_prefill_ms": 185.67920906934887, "ttft_ms": 12.047957978211343, "decode_ms": 11.850040988065302}, "total_wall_ms": 11849.513498949818, "ttft_ms": 12.047957978211343, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6691 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0e665ad4e80089ed6441be87", "attempt_id": "52c4c4ea9cc7", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:19.994474Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 449, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 1746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21056.896539987065, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245}, "receiver_prefill_ms": 164.56274990923703, "ttft_ms": 11.853333096951246, "decode_ms": 117.99962492659688}, "total_wall_ms": 21351.748873945326, "ttft_ms": 11.853333096951246, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "BU-55G-3254", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "98227e32c2121a7856e6d2b32b74598ce6f4183c2ec3eec7ce4b9b0b3f66b98b"} | |
| 6692 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "2df70b38d477858500554113", "attempt_id": "57411c6174b6", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:20.305605Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 454, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 1746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21056.896539987065, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245}, "receiver_prefill_ms": 184.66441705822945, "ttft_ms": 12.011292041279376, "decode_ms": 129.9014170654118}, "total_wall_ms": 21383.978081983514, "ttft_ms": 12.011292041279376, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 568-G in Mont-Laurier", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.5}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "98e007faa5a10742ad74f2778a64e3ea0d6b72bec1c0392200d475073d7bf082"} | |
| 6693 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0687e8c45124b05171238763", "attempt_id": "80743994c668", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:20.648131Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 454, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 1746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21056.896539987065, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245}, "receiver_prefill_ms": 185.12658297549933, "ttft_ms": 11.88695803284645, "decode_ms": 11.830750037916005}, "total_wall_ms": 21266.123705892824, "ttft_ms": 11.88695803284645, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6694 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a6271a37f0050d5fc481cbf1", "attempt_id": "3cfcf48721b7", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:20.872912Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 449, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 1746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21056.896539987065, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245}, "receiver_prefill_ms": 163.80154201760888, "ttft_ms": 11.907457956112921, "decode_ms": 11.8259999435395}, "total_wall_ms": 21244.801664957777, "ttft_ms": 11.907457956112921, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6695 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "43e8188e6fcbbaa714559065", "attempt_id": "5c0d580b8ef0", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:21.075420Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 455, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 1746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21056.896539987065, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245}, "receiver_prefill_ms": 184.74191706627607, "ttft_ms": 11.820500018075109, "decode_ms": 12.04025000333786}, "total_wall_ms": 21265.862830914557, "ttft_ms": 11.820500018075109, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6696 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c9dc205e7109900d187a806d", "attempt_id": "cf0c96dcba30", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:21.299314Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 459, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 1746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21056.896539987065, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245}, "receiver_prefill_ms": 185.26295793708414, "ttft_ms": 12.03054201323539, "decode_ms": 12.195541989058256}, "total_wall_ms": 21266.860874020495, "ttft_ms": 12.03054201323539, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6697 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "3ab9372f4939a85724fe460d", "attempt_id": "735ed43fda60", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:21.524660Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 448, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 1746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21056.896539987065, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245}, "receiver_prefill_ms": 164.92141596972942, "ttft_ms": 11.728417011909187, "decode_ms": 11.774874990805984}, "total_wall_ms": 21245.71341497358, "ttft_ms": 11.728417011909187, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | |
| 6698 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f5e3e1f4699c2e1eba0af4a2", "attempt_id": "de9c015cf9e1", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:21.729308Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 450, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 1746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21056.896539987065, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245}, "receiver_prefill_ms": 184.78320795111358, "ttft_ms": 11.876291944645345, "decode_ms": 11.811333009973168}, "total_wall_ms": 21265.739165013656, "ttft_ms": 11.876291944645345, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | |
| 6699 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "fc2f863d93ab99742e6425c2", "attempt_id": "c82ad5dcf1f1", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:21.952962Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 466, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 1746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21056.896539987065, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245}, "receiver_prefill_ms": 185.4307500179857, "ttft_ms": 12.07654201425612, "decode_ms": 11.884083040058613}, "total_wall_ms": 21266.66474796366, "ttft_ms": 12.07654201425612, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6700 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "1baa789d177e91815ae7c290", "attempt_id": "4977b3e56415", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:22.177851Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 457, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 1746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21056.896539987065, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245}, "receiver_prefill_ms": 185.31995895318687, "ttft_ms": 11.825166991911829, "decode_ms": 11.875541997142136}, "total_wall_ms": 21266.290581901558, "ttft_ms": 11.825166991911829, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6701 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "6880837c1ad977807c81a8c7", "attempt_id": "795d5a0d3d3c", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:22.402353Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 467, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 1746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21056.896539987065, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245}, "receiver_prefill_ms": 185.88358291890472, "ttft_ms": 11.947875027544796, "decode_ms": 11.9317090138793}, "total_wall_ms": 21267.132830922492, "ttft_ms": 11.947875027544796, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6702 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "2901c2cc1c8400aed5c10162", "attempt_id": "7434807679c6", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:22.627525Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 460, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 1746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21056.896539987065, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245}, "receiver_prefill_ms": 185.49416703172028, "ttft_ms": 11.954375077039003, "decode_ms": 82.17991702258587}, "total_wall_ms": 21336.92470600363, "ttft_ms": 11.954375077039003, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8066734", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "167c75fdd6a41fca64228797ab8f3a1a3f994475246df0bffb2e060d5d2e4ff0"} | |
| 6703 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "3aa487a1dd3a5c87a1d77098", "attempt_id": "3db19c9fbe5b", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:22.923126Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 457, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 1746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21056.896539987065, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245}, "receiver_prefill_ms": 185.62016694340855, "ttft_ms": 11.85858401004225, "decode_ms": 11.833833996206522}, "total_wall_ms": 21266.592290019616, "ttft_ms": 11.85858401004225, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6704 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4442e52b34025e6a191afe2f", "attempt_id": "e81310278a02", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:23.148148Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 461, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 1746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21056.896539987065, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245}, "receiver_prefill_ms": 185.344333993271, "ttft_ms": 11.912125046364963, "decode_ms": 11.801417102105916}, "total_wall_ms": 21266.318249050528, "ttft_ms": 11.912125046364963, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6705 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c9f045d2e63d93e8d6a99d2f", "attempt_id": "b4a5e56399cf", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:23.372326Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 462, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 1746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21056.896539987065, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245}, "receiver_prefill_ms": 185.00958301592618, "ttft_ms": 12.10662501398474, "decode_ms": 11.93462498486042}, "total_wall_ms": 21266.433289973065, "ttft_ms": 12.10662501398474, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6706 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "8fc64bc3cad06c9588215dad", "attempt_id": "5e8695b9cc3d", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:42.448490Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 449, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 4074, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 39903.3381229965, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245, "5": 4711.475750082172, "6": 4709.1882498934865, "7": 4716.373875038698, "8": 4709.4037079950795}, "receiver_prefill_ms": 164.31158292107284, "ttft_ms": 11.830041999928653, "decode_ms": 118.30420908518136}, "total_wall_ms": 40198.22749809828, "ttft_ms": 11.830041999928653, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "BU-55G-3254", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "98227e32c2121a7856e6d2b32b74598ce6f4183c2ec3eec7ce4b9b0b3f66b98b"} | |
| 6707 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4ca4383ae11ed99ab4be24fd", "attempt_id": "9f3af4dbc6ca", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:42.759966Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 454, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 4074, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 39903.3381229965, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245, "5": 4711.475750082172, "6": 4709.1882498934865, "7": 4716.373875038698, "8": 4709.4037079950795}, "receiver_prefill_ms": 185.30508305411786, "ttft_ms": 11.870500049553812, "decode_ms": 11.98899990413338}, "total_wall_ms": 40112.903831060976, "ttft_ms": 11.870500049553812, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6708 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d9af521fe603265dcd61405b", "attempt_id": "a4e31c2666a5", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:42.985024Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 454, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 4074, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 39903.3381229965, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245, "5": 4711.475750082172, "6": 4709.1882498934865, "7": 4716.373875038698, "8": 4709.4037079950795}, "receiver_prefill_ms": 185.3665839880705, "ttft_ms": 11.911417008377612, "decode_ms": 12.037124950438738}, "total_wall_ms": 40113.028290099464, "ttft_ms": 11.911417008377612, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6709 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d644cd219138f195496a6d51", "attempt_id": "8366d6394f45", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:43.210258Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 449, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 4074, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 39903.3381229965, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245, "5": 4711.475750082172, "6": 4709.1882498934865, "7": 4716.373875038698, "8": 4709.4037079950795}, "receiver_prefill_ms": 164.26441702060401, "ttft_ms": 11.79575000423938, "decode_ms": 11.690332903526723}, "total_wall_ms": 40091.45541500766, "ttft_ms": 11.79575000423938, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6710 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "967619c4f4f2ca8f1dcd00f8", "attempt_id": "d11cd46bc111", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:43.413397Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 455, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 4074, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 39903.3381229965, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245, "5": 4711.475750082172, "6": 4709.1882498934865, "7": 4716.373875038698, "8": 4709.4037079950795}, "receiver_prefill_ms": 185.41454209480435, "ttft_ms": 11.846874956972897, "decode_ms": 11.894208961166441}, "total_wall_ms": 40112.84574808087, "ttft_ms": 11.846874956972897, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6711 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5831b593dd59b0101bd7e0ba", "attempt_id": "1466ef0c5242", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:43.638039Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 459, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 4074, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 39903.3381229965, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245, "5": 4711.475750082172, "6": 4709.1882498934865, "7": 4716.373875038698, "8": 4709.4037079950795}, "receiver_prefill_ms": 185.5804999358952, "ttft_ms": 11.820833082310855, "decode_ms": 11.707291007041931}, "total_wall_ms": 40112.84791503567, "ttft_ms": 11.820833082310855, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6712 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "997ad129bc8fd46175b9fbb6", "attempt_id": "b60ff342f297", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:43.863054Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 448, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 4074, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 39903.3381229965, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245, "5": 4711.475750082172, "6": 4709.1882498934865, "7": 4716.373875038698, "8": 4709.4037079950795}, "receiver_prefill_ms": 163.71025005355477, "ttft_ms": 12.047083000652492, "decode_ms": 11.986915953457355}, "total_wall_ms": 40091.58279001713, "ttft_ms": 12.047083000652492, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | |
| 6713 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "bc715339cd3a5b092ab0917c", "attempt_id": "132a9cf5c14a", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:44.066533Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 450, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 4074, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 39903.3381229965, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245, "5": 4711.475750082172, "6": 4709.1882498934865, "7": 4716.373875038698, "8": 4709.4037079950795}, "receiver_prefill_ms": 184.9652089877054, "ttft_ms": 11.876665987074375, "decode_ms": 11.847666930407286}, "total_wall_ms": 40112.41283197887, "ttft_ms": 11.876665987074375, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | |
| 6714 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "289389570fdead364afe57cd", "attempt_id": "8215859f24aa", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:44.291414Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 466, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 4074, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 39903.3381229965, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245, "5": 4711.475750082172, "6": 4709.1882498934865, "7": 4716.373875038698, "8": 4709.4037079950795}, "receiver_prefill_ms": 186.13395793363452, "ttft_ms": 11.890332913026214, "decode_ms": 11.867624940350652}, "total_wall_ms": 40113.636623020284, "ttft_ms": 11.890332913026214, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6715 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "1a75f72cbdf1789e1a4b0bea", "attempt_id": "7918716ca426", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:44.516912Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 457, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 4074, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 39903.3381229965, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245, "5": 4711.475750082172, "6": 4709.1882498934865, "7": 4716.373875038698, "8": 4709.4037079950795}, "receiver_prefill_ms": 185.54324994329363, "ttft_ms": 11.868958012200892, "decode_ms": 11.753374943509698}, "total_wall_ms": 40112.881915061735, "ttft_ms": 11.868958012200892, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6716 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7b3c24aefef39fcd15ed4f6b", "attempt_id": "5a8d1c87703f", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:44.741923Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 467, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 4074, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 39903.3381229965, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245, "5": 4711.475750082172, "6": 4709.1882498934865, "7": 4716.373875038698, "8": 4709.4037079950795}, "receiver_prefill_ms": 185.2469160221517, "ttft_ms": 11.851832969114184, "decode_ms": 11.884917039424181}, "total_wall_ms": 40112.6968319295, "ttft_ms": 11.851832969114184, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6717 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c1ef69fa9d14f6018e17a8a5", "attempt_id": "d62e988f09e2", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:44.966402Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 460, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 4074, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 39903.3381229965, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245, "5": 4711.475750082172, "6": 4709.1882498934865, "7": 4716.373875038698, "8": 4709.4037079950795}, "receiver_prefill_ms": 185.5697090504691, "ttft_ms": 11.85687503311783, "decode_ms": 82.77320803608745}, "total_wall_ms": 40183.931623003446, "ttft_ms": 11.85687503311783, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8066734", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "167c75fdd6a41fca64228797ab8f3a1a3f994475246df0bffb2e060d5d2e4ff0"} | |
| 6718 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "8e993e2b93f3d7d252e07ac7", "attempt_id": "9af155bbb6c5", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:45.262135Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 457, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 4074, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 39903.3381229965, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245, "5": 4711.475750082172, "6": 4709.1882498934865, "7": 4716.373875038698, "8": 4709.4037079950795}, "receiver_prefill_ms": 185.13104098383337, "ttft_ms": 11.781290988437831, "decode_ms": 11.864875094033778}, "total_wall_ms": 40112.47958091553, "ttft_ms": 11.781290988437831, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6719 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c9802cdde1eaf14dab20233b", "attempt_id": "307bd52ae976", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:45.486687Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 461, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 4074, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 39903.3381229965, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245, "5": 4711.475750082172, "6": 4709.1882498934865, "7": 4716.373875038698, "8": 4709.4037079950795}, "receiver_prefill_ms": 185.66183291841298, "ttft_ms": 11.656958027742803, "decode_ms": 11.801082990132272}, "total_wall_ms": 40112.91949788574, "ttft_ms": 11.656958027742803, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6720 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "852f08d7cdd2d42c1f2c6935", "attempt_id": "e9a0318599ce", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:45.711271Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 462, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 4074, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 39903.3381229965, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245, "5": 4711.475750082172, "6": 4709.1882498934865, "7": 4716.373875038698, "8": 4709.4037079950795}, "receiver_prefill_ms": 185.55879197083414, "ttft_ms": 12.172917020507157, "decode_ms": 11.823417036794126}, "total_wall_ms": 40113.387331948616, "ttft_ms": 12.172917020507157, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6721 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "68f50df0be63c2da43fbe79a", "attempt_id": "4db60b8ac599", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:52.884291Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6944.753459072672, "hops": {"1": 6944.753459072672}, "receiver_prefill_ms": 227.1524170646444, "ttft_ms": 11.938499985262752, "decode_ms": 11.892291018739343}, "total_wall_ms": 7196.284751058556, "ttft_ms": 11.938499985262752, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6722 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e11e0d2619d789e65d5058f3", "attempt_id": "6cfd25bdbfc0", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:53.152589Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6944.753459072672, "hops": {"1": 6944.753459072672}, "receiver_prefill_ms": 227.1518340567127, "ttft_ms": 11.90512499306351, "decode_ms": 11.911417008377612}, "total_wall_ms": 7196.398084051907, "ttft_ms": 11.90512499306351, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6723 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "fae165009be3b7cb6f9d6d32", "attempt_id": "219d24d19ec8", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:53.420308Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6944.753459072672, "hops": {"1": 6944.753459072672}, "receiver_prefill_ms": 227.42758295498788, "ttft_ms": 11.96104206610471, "decode_ms": 83.00912496633828}, "total_wall_ms": 7267.676292103715, "ttft_ms": 11.96104206610471, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "30.0224", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "e28a78bc4deb3cec8beab4bf5b87297d7cc55a3e6f839b43fe6408735d464923"} | |
| 6724 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "02dc215c8204ba577fbbea51", "attempt_id": "857f65976221", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:53.759086Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6944.753459072672, "hops": {"1": 6944.753459072672}, "receiver_prefill_ms": 226.56595904845744, "ttft_ms": 12.16012507211417, "decode_ms": 11.987749952822924}, "total_wall_ms": 7196.175834047608, "ttft_ms": 12.16012507211417, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6725 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "8c511232ddd04769672c226c", "attempt_id": "68804eda82b6", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:54.026161Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 601, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6944.753459072672, "hops": {"1": 6944.753459072672}, "receiver_prefill_ms": 227.2182919550687, "ttft_ms": 11.998250032775104, "decode_ms": 106.68470803648233}, "total_wall_ms": 7291.227417066693, "ttft_ms": 11.998250032775104, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,009,480", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "30b20d9aae4d7b0587edeefdc2a9a159f73faf6e2570f1d408a415fe92cbf45e"} | |
| 6726 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "00ac6ff047f1da2dba0f40f9", "attempt_id": "c52537b35467", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:54.388737Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 605, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6944.753459072672, "hops": {"1": 6944.753459072672}, "receiver_prefill_ms": 227.1752500673756, "ttft_ms": 12.066584080457687, "decode_ms": 12.00175005942583}, "total_wall_ms": 7196.650042082183, "ttft_ms": 12.066584080457687, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6727 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "39c502bfca2daed29daa04dc", "attempt_id": "7506e57ceb8b", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:54.657417Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 594, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6944.753459072672, "hops": {"1": 6944.753459072672}, "receiver_prefill_ms": 227.0451249787584, "ttft_ms": 11.883500032126904, "decode_ms": 11.969916056841612}, "total_wall_ms": 7196.165043045767, "ttft_ms": 11.883500032126904, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | |
| 6728 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "406514a3b1fcdf8c764b2cf5", "attempt_id": "e203d9c2cdda", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:54.925033Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 596, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6944.753459072672, "hops": {"1": 6944.753459072672}, "receiver_prefill_ms": 227.03204106073827, "ttft_ms": 11.973832966759801, "decode_ms": 11.963958968408406}, "total_wall_ms": 7196.251251152717, "ttft_ms": 11.973832966759801, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | |
| 6729 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "34866c010d028255202e6678", "attempt_id": "1be1746ce157", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:55.192486Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 612, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6944.753459072672, "hops": {"1": 6944.753459072672}, "receiver_prefill_ms": 229.4199160533026, "ttft_ms": 11.845832923427224, "decode_ms": 11.970583000220358}, "total_wall_ms": 7198.51283414755, "ttft_ms": 11.845832923427224, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6730 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "385e7e889a365c58210ad056", "attempt_id": "2f0b0c70941d", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:55.461693Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6944.753459072672, "hops": {"1": 6944.753459072672}, "receiver_prefill_ms": 227.41287492681295, "ttft_ms": 11.94062503054738, "decode_ms": 11.902958038263023}, "total_wall_ms": 7196.541083976626, "ttft_ms": 11.94062503054738, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6731 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "babe670b47b3449042e1dba4", "attempt_id": "c0a4dd05c363", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:55.728948Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 613, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6944.753459072672, "hops": {"1": 6944.753459072672}, "receiver_prefill_ms": 229.5377500122413, "ttft_ms": 11.927249957807362, "decode_ms": 12.015708023682237}, "total_wall_ms": 7198.722709086724, "ttft_ms": 11.927249957807362, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6732 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0dafcf322c7b111ebba73e59", "attempt_id": "9c044929c5b6", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:55.998335Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6944.753459072672, "hops": {"1": 6944.753459072672}, "receiver_prefill_ms": 227.59179095737636, "ttft_ms": 11.944000027142465, "decode_ms": 83.36770895402879}, "total_wall_ms": 7268.157125101425, "ttft_ms": 11.944000027142465, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2707654", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "7799e805760fa6568574360f61d4c7cc9e162842191ff434dfed71076922855e"} | |
| 6733 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "6ce601a2052216f87b89273b", "attempt_id": "359803814e4a", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:56.336875Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6944.753459072672, "hops": {"1": 6944.753459072672}, "receiver_prefill_ms": 227.23837499506772, "ttft_ms": 12.079291976988316, "decode_ms": 11.961207957938313}, "total_wall_ms": 7196.67954207398, "ttft_ms": 12.079291976988316, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6734 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "71d9edf8102fdd8fa05fdfb0", "attempt_id": "dcfff703ac93", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:56.604501Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 607, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6944.753459072672, "hops": {"1": 6944.753459072672}, "receiver_prefill_ms": 227.17162501066923, "ttft_ms": 11.984833050519228, "decode_ms": 11.980416951701045}, "total_wall_ms": 7196.417959057726, "ttft_ms": 11.984833050519228, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6735 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "3e80711c1c4b49dbcdf9a792", "attempt_id": "4a51d726041c", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:56.871886Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 608, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6944.753459072672, "hops": {"1": 6944.753459072672}, "receiver_prefill_ms": 226.47537500597537, "ttft_ms": 12.374832993373275, "decode_ms": 12.116165948100388}, "total_wall_ms": 7196.464334032498, "ttft_ms": 12.374832993373275, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6736 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b4f324d6da35d9081f7dd04a", "attempt_id": "02572e4cbbc2", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:02.701137Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 559, "message_tokens": 456, "message_utf8_bytes": 1579, "cache_tensor_bytes": null, "serialized_payload_bytes": 1579, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 12504.99008409679, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175}, "receiver_prefill_ms": 211.97016700170934, "ttft_ms": 11.616958072409034, "decode_ms": 80.87270800024271}, "total_wall_ms": 12810.002376092598, "ttft_ms": 11.616958072409034, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "CT-24D-4130", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7105614ab75d6c721015e472329580cee0345d85cb536748ebca5e81e8dbca22", "output_hash": "ef4c922649b61c51f72c7c8c9d9c9941a9d5c51879072478dde9d6a044f0fdc5"} | |
| 6737 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "49bbf7e6cd5b317d2dee3c10", "attempt_id": "6f549b7c583f", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:03.022454Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 564, "message_tokens": 456, "message_utf8_bytes": 1579, "cache_tensor_bytes": null, "serialized_payload_bytes": 1579, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 12504.99008409679, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175}, "receiver_prefill_ms": 212.2890829341486, "ttft_ms": 11.661082971841097, "decode_ms": 11.755208019167185}, "total_wall_ms": 12741.194042144343, "ttft_ms": 11.661082971841097, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7105614ab75d6c721015e472329580cee0345d85cb536748ebca5e81e8dbca22", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6738 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "97c4b9a4cae7feb9f4d996f6", "attempt_id": "99544a096fd0", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:03.274132Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 564, "message_tokens": 456, "message_utf8_bytes": 1579, "cache_tensor_bytes": null, "serialized_payload_bytes": 1579, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 12504.99008409679, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175}, "receiver_prefill_ms": 211.0874579520896, "ttft_ms": 11.825416004285216, "decode_ms": 46.2122909957543}, "total_wall_ms": 12774.739751126617, "ttft_ms": 11.825416004285216, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "30.0224", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7105614ab75d6c721015e472329580cee0345d85cb536748ebca5e81e8dbca22", "output_hash": "e28a78bc4deb3cec8beab4bf5b87297d7cc55a3e6f839b43fe6408735d464923"} | |
| 6739 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5487615749e711fcdc3eb6bf", "attempt_id": "04d459727032", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:03.559092Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 559, "message_tokens": 456, "message_utf8_bytes": 1579, "cache_tensor_bytes": null, "serialized_payload_bytes": 1579, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 12504.99008409679, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175}, "receiver_prefill_ms": 211.9234170531854, "ttft_ms": 11.812791926786304, "decode_ms": 11.560500017367303}, "total_wall_ms": 12740.752417128533, "ttft_ms": 11.812791926786304, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7105614ab75d6c721015e472329580cee0345d85cb536748ebca5e81e8dbca22", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6740 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "8b26fe7c0df9a4efff0c4c74", "attempt_id": "2d7916462ea4", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:03.810604Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 566, "message_tokens": 456, "message_utf8_bytes": 1579, "cache_tensor_bytes": null, "serialized_payload_bytes": 1579, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 12504.99008409679, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175}, "receiver_prefill_ms": 212.04395906534046, "ttft_ms": 11.588540975935757, "decode_ms": 57.86379100754857}, "total_wall_ms": 12786.96691710502, "ttft_ms": 11.588540975935757, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,009,480", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7105614ab75d6c721015e472329580cee0345d85cb536748ebca5e81e8dbca22", "output_hash": "30b20d9aae4d7b0587edeefdc2a9a159f73faf6e2570f1d408a415fe92cbf45e"} | |
| 6741 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f8b9c028b74ba3f70ca5b894", "attempt_id": "5ce45c38bf17", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:04.108005Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 568, "message_tokens": 456, "message_utf8_bytes": 1579, "cache_tensor_bytes": null, "serialized_payload_bytes": 1579, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 12504.99008409679, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175}, "receiver_prefill_ms": 212.4286670004949, "ttft_ms": 11.623249971307814, "decode_ms": 11.489375028759241}, "total_wall_ms": 12740.999334026128, "ttft_ms": 11.623249971307814, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7105614ab75d6c721015e472329580cee0345d85cb536748ebca5e81e8dbca22", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6742 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "32dc7df69e7d376f96bb6054", "attempt_id": "e4411a4ecf69", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:04.359303Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 559, "message_tokens": 456, "message_utf8_bytes": 1579, "cache_tensor_bytes": null, "serialized_payload_bytes": 1579, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 12504.99008409679, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175}, "receiver_prefill_ms": 211.47954103071243, "ttft_ms": 11.694958084262908, "decode_ms": 23.376333992928267}, "total_wall_ms": 12752.191834151745, "ttft_ms": 11.694958084262908, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7105614ab75d6c721015e472329580cee0345d85cb536748ebca5e81e8dbca22", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | |
| 6743 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f9d7762f9ac9b03675c3120e", "attempt_id": "7e3fe8f8181f", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:04.621781Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 560, "message_tokens": 456, "message_utf8_bytes": 1579, "cache_tensor_bytes": null, "serialized_payload_bytes": 1579, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 12504.99008409679, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175}, "receiver_prefill_ms": 211.97699999902397, "ttft_ms": 11.56116696074605, "decode_ms": 23.316249949857593}, "total_wall_ms": 12752.484542084858, "ttft_ms": 11.56116696074605, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7105614ab75d6c721015e472329580cee0345d85cb536748ebca5e81e8dbca22", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | |
| 6744 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "649f4a52bd99f4b73bf23100", "attempt_id": "70692f9e60e7", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:04.885108Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 576, "message_tokens": 456, "message_utf8_bytes": 1579, "cache_tensor_bytes": null, "serialized_payload_bytes": 1579, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 12504.99008409679, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175}, "receiver_prefill_ms": 212.21516700461507, "ttft_ms": 12.015625019557774, "decode_ms": 11.65220804978162}, "total_wall_ms": 12741.531834122725, "ttft_ms": 12.015625019557774, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7105614ab75d6c721015e472329580cee0345d85cb536748ebca5e81e8dbca22", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6745 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b43245129a659e905753ecfc", "attempt_id": "1916b8d91973", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:05.137704Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 567, "message_tokens": 456, "message_utf8_bytes": 1579, "cache_tensor_bytes": null, "serialized_payload_bytes": 1579, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 12504.99008409679, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175}, "receiver_prefill_ms": 212.25241606589407, "ttft_ms": 11.684166034683585, "decode_ms": 11.535666999407113}, "total_wall_ms": 12740.972751169465, "ttft_ms": 11.684166034683585, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7105614ab75d6c721015e472329580cee0345d85cb536748ebca5e81e8dbca22", "output_hash": "b764cdc0eab7137467211272fa539f1260d1bf2e71bcf6ff3bdc960f5c16aa14"} | |
| 6746 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "1527f0659f51f503c5cfa7c9", "attempt_id": "cd2354957210", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:05.389510Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 576, "message_tokens": 456, "message_utf8_bytes": 1579, "cache_tensor_bytes": null, "serialized_payload_bytes": 1579, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 12504.99008409679, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175}, "receiver_prefill_ms": 212.76787505485117, "ttft_ms": 11.658875038847327, "decode_ms": 11.655832990072668}, "total_wall_ms": 12741.532542160712, "ttft_ms": 11.658875038847327, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7105614ab75d6c721015e472329580cee0345d85cb536748ebca5e81e8dbca22", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6747 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f82a48787694dc7a1a39bd4f", "attempt_id": "120e47cec02b", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:05.641281Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 571, "message_tokens": 456, "message_utf8_bytes": 1579, "cache_tensor_bytes": null, "serialized_payload_bytes": 1579, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 12504.99008409679, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175}, "receiver_prefill_ms": 212.16933405958116, "ttft_ms": 11.637625051662326, "decode_ms": 57.92537494562566}, "total_wall_ms": 12787.278209114447, "ttft_ms": 11.637625051662326, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "11,085,310", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7105614ab75d6c721015e472329580cee0345d85cb536748ebca5e81e8dbca22", "output_hash": "759234a32a22ec346567fe3fddc1cee453d2284580e2c63d21796dc4d97af3f0"} | |
| 6748 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0e7ed76be5dda33f02ba3dc8", "attempt_id": "c748e3d56eef", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:05.938877Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 567, "message_tokens": 456, "message_utf8_bytes": 1579, "cache_tensor_bytes": null, "serialized_payload_bytes": 1579, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 12504.99008409679, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175}, "receiver_prefill_ms": 211.69579098932445, "ttft_ms": 11.639332980848849, "decode_ms": 11.567125096917152}, "total_wall_ms": 12740.377584123053, "ttft_ms": 11.639332980848849, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7105614ab75d6c721015e472329580cee0345d85cb536748ebca5e81e8dbca22", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6749 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "90473dad2993e92aed0169de", "attempt_id": "b486bb8cc8e5", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:06.189964Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 571, "message_tokens": 456, "message_utf8_bytes": 1579, "cache_tensor_bytes": null, "serialized_payload_bytes": 1579, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 12504.99008409679, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175}, "receiver_prefill_ms": 212.50716701615602, "ttft_ms": 11.632375069893897, "decode_ms": 11.580291902646422}, "total_wall_ms": 12741.362876142375, "ttft_ms": 11.632375069893897, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7105614ab75d6c721015e472329580cee0345d85cb536748ebca5e81e8dbca22", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6750 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "80b9cd275f630db236ee1cd0", "attempt_id": "d5757000dff5", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:06.441617Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 573, "message_tokens": 456, "message_utf8_bytes": 1579, "cache_tensor_bytes": null, "serialized_payload_bytes": 1579, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 12504.99008409679, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175}, "receiver_prefill_ms": 212.03270799014717, "ttft_ms": 11.574291973374784, "decode_ms": 11.784041998907924}, "total_wall_ms": 12740.904167061672, "ttft_ms": 11.574291973374784, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7105614ab75d6c721015e472329580cee0345d85cb536748ebca5e81e8dbca22", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6751 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d2cf26d2ac7fdf55d6d09cc2", "attempt_id": "e9d255dcf895", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:18.110008Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 514, "message_tokens": 411, "message_utf8_bytes": 1606, "cache_tensor_bytes": null, "serialized_payload_bytes": 1606, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23918.322250130586, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444}, "receiver_prefill_ms": 209.95479193516076, "ttft_ms": 11.591459042392671, "decode_ms": 11.725915945135057}, "total_wall_ms": 24152.113250107504, "ttft_ms": 11.591459042392671, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9df441bcc254691aca50ef729117ceda7fcec91596ba108d61042763177cb3a7", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6752 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c50016ca784113b8411cd237", "attempt_id": "a88fe76f2f5f", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:18.359935Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 519, "message_tokens": 411, "message_utf8_bytes": 1606, "cache_tensor_bytes": null, "serialized_payload_bytes": 1606, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23918.322250130586, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444}, "receiver_prefill_ms": 209.8256249446422, "ttft_ms": 11.622958001680672, "decode_ms": 11.49333396460861}, "total_wall_ms": 24151.864167070016, "ttft_ms": 11.622958001680672, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9df441bcc254691aca50ef729117ceda7fcec91596ba108d61042763177cb3a7", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6753 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e0ca350d858a89d79fd390fe", "attempt_id": "8720f9b8db35", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:18.609003Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 519, "message_tokens": 411, "message_utf8_bytes": 1606, "cache_tensor_bytes": null, "serialized_payload_bytes": 1606, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23918.322250130586, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444}, "receiver_prefill_ms": 209.50975001323968, "ttft_ms": 11.60995801910758, "decode_ms": 46.00933298934251}, "total_wall_ms": 24185.910208150744, "ttft_ms": 11.60995801910758, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "30.0224", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9df441bcc254691aca50ef729117ceda7fcec91596ba108d61042763177cb3a7", "output_hash": "e28a78bc4deb3cec8beab4bf5b87297d7cc55a3e6f839b43fe6408735d464923"} | |
| 6754 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "eaf153d40e5dd83ab2253030", "attempt_id": "38b1d9b250ce", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:18.892280Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 514, "message_tokens": 411, "message_utf8_bytes": 1606, "cache_tensor_bytes": null, "serialized_payload_bytes": 1606, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23918.322250130586, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444}, "receiver_prefill_ms": 209.6272500930354, "ttft_ms": 11.58116606529802, "decode_ms": 11.570165981538594}, "total_wall_ms": 24151.551791117527, "ttft_ms": 11.58116606529802, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9df441bcc254691aca50ef729117ceda7fcec91596ba108d61042763177cb3a7", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6755 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4395b20aed0c24c72eb49f25", "attempt_id": "70a5f9836700", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:19.140476Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 521, "message_tokens": 411, "message_utf8_bytes": 1606, "cache_tensor_bytes": null, "serialized_payload_bytes": 1606, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23918.322250130586, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444}, "receiver_prefill_ms": 209.93962499778718, "ttft_ms": 11.500249966047704, "decode_ms": 57.71816708147526}, "total_wall_ms": 24198.06879211683, "ttft_ms": 11.500249966047704, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,009,480", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9df441bcc254691aca50ef729117ceda7fcec91596ba108d61042763177cb3a7", "output_hash": "30b20d9aae4d7b0587edeefdc2a9a159f73faf6e2570f1d408a415fe92cbf45e"} | |
| 6756 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0156396c92732a83f57119da", "attempt_id": "7f2b29fe2eae", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:19.435268Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 523, "message_tokens": 411, "message_utf8_bytes": 1606, "cache_tensor_bytes": null, "serialized_payload_bytes": 1606, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23918.322250130586, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444}, "receiver_prefill_ms": 210.1938750129193, "ttft_ms": 11.526582995429635, "decode_ms": 11.78062497638166}, "total_wall_ms": 24152.32833311893, "ttft_ms": 11.526582995429635, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9df441bcc254691aca50ef729117ceda7fcec91596ba108d61042763177cb3a7", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6757 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d48a71040ca2b766ec3dfcf3", "attempt_id": "0b2aba828063", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:19.684908Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 514, "message_tokens": 411, "message_utf8_bytes": 1606, "cache_tensor_bytes": null, "serialized_payload_bytes": 1606, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23918.322250130586, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444}, "receiver_prefill_ms": 209.58245801739395, "ttft_ms": 11.653708992525935, "decode_ms": 22.99008402042091}, "total_wall_ms": 24162.9817080684, "ttft_ms": 11.653708992525935, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9df441bcc254691aca50ef729117ceda7fcec91596ba108d61042763177cb3a7", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | |
| 6758 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c9bc382494a3a0be370a1b8e", "attempt_id": "7d777366268d", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:19.944599Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 515, "message_tokens": 411, "message_utf8_bytes": 1606, "cache_tensor_bytes": null, "serialized_payload_bytes": 1606, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23918.322250130586, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444}, "receiver_prefill_ms": 209.60525004193187, "ttft_ms": 11.536874924786389, "decode_ms": 23.005667026154697}, "total_wall_ms": 24162.907750112936, "ttft_ms": 11.536874924786389, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9df441bcc254691aca50ef729117ceda7fcec91596ba108d61042763177cb3a7", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | |
| 6759 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "43091c788a0fb7c5874a16cc", "attempt_id": "771c5dc51338", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:20.204158Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 531, "message_tokens": 411, "message_utf8_bytes": 1606, "cache_tensor_bytes": null, "serialized_payload_bytes": 1606, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23918.322250130586, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444}, "receiver_prefill_ms": 210.17629199195653, "ttft_ms": 11.611875030212104, "decode_ms": 11.541125015355647}, "total_wall_ms": 24152.276833192445, "ttft_ms": 11.611875030212104, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9df441bcc254691aca50ef729117ceda7fcec91596ba108d61042763177cb3a7", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6760 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7cab3c73da43ba26f7bcfb93", "attempt_id": "4ceefbea26ee", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:20.452913Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 522, "message_tokens": 411, "message_utf8_bytes": 1606, "cache_tensor_bytes": null, "serialized_payload_bytes": 1606, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23918.322250130586, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444}, "receiver_prefill_ms": 209.83304106630385, "ttft_ms": 11.75800000783056, "decode_ms": 11.580749996937811}, "total_wall_ms": 24152.088042115793, "ttft_ms": 11.75800000783056, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9df441bcc254691aca50ef729117ceda7fcec91596ba108d61042763177cb3a7", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6761 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "162b350a6b5fb319bd25108c", "attempt_id": "3940956f32a5", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:20.703231Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 531, "message_tokens": 411, "message_utf8_bytes": 1606, "cache_tensor_bytes": null, "serialized_payload_bytes": 1606, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23918.322250130586, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444}, "receiver_prefill_ms": 210.2346250321716, "ttft_ms": 11.699000024236739, "decode_ms": 11.551374918781221}, "total_wall_ms": 24152.424250147305, "ttft_ms": 11.699000024236739, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9df441bcc254691aca50ef729117ceda7fcec91596ba108d61042763177cb3a7", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6762 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "1eb5af42cd4bff7c0fe3db72", "attempt_id": "f038a2d9d3ba", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:20.952821Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 526, "message_tokens": 411, "message_utf8_bytes": 1606, "cache_tensor_bytes": null, "serialized_payload_bytes": 1606, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23918.322250130586, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444}, "receiver_prefill_ms": 210.15895798336715, "ttft_ms": 11.71933300793171, "decode_ms": 57.41829099133611}, "total_wall_ms": 24198.201042134315, "ttft_ms": 11.71933300793171, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "11,120,310", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9df441bcc254691aca50ef729117ceda7fcec91596ba108d61042763177cb3a7", "output_hash": "c4e2d208e7fb67c45a0af9f9a6d4964665fdcf54126bdc7d4d62a5c42e59adf2"} | |
| 6763 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a5d26c83ba82f55989600b2c", "attempt_id": "4c9b6e48be4d", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:21.248874Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 522, "message_tokens": 411, "message_utf8_bytes": 1606, "cache_tensor_bytes": null, "serialized_payload_bytes": 1606, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23918.322250130586, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444}, "receiver_prefill_ms": 209.70904105342925, "ttft_ms": 11.660916963592172, "decode_ms": 11.569375055842102}, "total_wall_ms": 24151.899458141997, "ttft_ms": 11.660916963592172, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9df441bcc254691aca50ef729117ceda7fcec91596ba108d61042763177cb3a7", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6764 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d203749cb9f3ead5f700a8fb", "attempt_id": "3bbb9b694eb9", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:21.498526Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 526, "message_tokens": 411, "message_utf8_bytes": 1606, "cache_tensor_bytes": null, "serialized_payload_bytes": 1606, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23918.322250130586, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444}, "receiver_prefill_ms": 209.973624907434, "ttft_ms": 11.686792015098035, "decode_ms": 11.549124959856272}, "total_wall_ms": 24152.119250036776, "ttft_ms": 11.686792015098035, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9df441bcc254691aca50ef729117ceda7fcec91596ba108d61042763177cb3a7", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6765 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "50b01c048336574be4196ea1", "attempt_id": "c063cd9223f8", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:21.748984Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 528, "message_tokens": 411, "message_utf8_bytes": 1606, "cache_tensor_bytes": null, "serialized_payload_bytes": 1606, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23918.322250130586, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444}, "receiver_prefill_ms": 210.39549994748086, "ttft_ms": 11.564792017452419, "decode_ms": 11.556208948604763}, "total_wall_ms": 24152.326250099577, "ttft_ms": 11.564792017452419, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9df441bcc254691aca50ef729117ceda7fcec91596ba108d61042763177cb3a7", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6766 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0a53eb29c116facf1120564f", "attempt_id": "2318f6be076a", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:43.733317Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 514, "message_tokens": 411, "message_utf8_bytes": 1572, "cache_tensor_bytes": null, "serialized_payload_bytes": 1572, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 45646.34845801629, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444, "5": 5870.618999935687, "6": 5081.656874972396, "7": 5788.924874970689, "8": 4986.825458006933}, "receiver_prefill_ms": 209.4774170545861, "ttft_ms": 11.706708930432796, "decode_ms": 11.513833072967827}, "total_wall_ms": 45879.62020805571, "ttft_ms": 11.706708930432796, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "5": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1580}, "6": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1614}, "7": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1539}, "8": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5f91a90ae14ae9b8b6fe51726c465074152fb5d1c9595ff18bd7d10fb4e9aa4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6767 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d19a9e872122659e4354d6b1", "attempt_id": "0fa981dd2b36", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:43.982805Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 519, "message_tokens": 411, "message_utf8_bytes": 1572, "cache_tensor_bytes": null, "serialized_payload_bytes": 1572, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 45646.34845801629, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444, "5": 5870.618999935687, "6": 5081.656874972396, "7": 5788.924874970689, "8": 4986.825458006933}, "receiver_prefill_ms": 209.87370796501637, "ttft_ms": 11.523750028572977, "decode_ms": 11.485249968245625}, "total_wall_ms": 45879.67462395318, "ttft_ms": 11.523750028572977, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "5": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1580}, "6": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1614}, "7": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1539}, "8": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5f91a90ae14ae9b8b6fe51726c465074152fb5d1c9595ff18bd7d10fb4e9aa4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6768 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4a042778f42cc7d5dcc8b8b5", "attempt_id": "e632c4b929b4", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:44.231979Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 519, "message_tokens": 411, "message_utf8_bytes": 1572, "cache_tensor_bytes": null, "serialized_payload_bytes": 1572, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 45646.34845801629, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444, "5": 5870.618999935687, "6": 5081.656874972396, "7": 5788.924874970689, "8": 4986.825458006933}, "receiver_prefill_ms": 210.03379102330655, "ttft_ms": 11.518332990817726, "decode_ms": 45.96875002607703}, "total_wall_ms": 45914.309291983955, "ttft_ms": 11.518332990817726, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "30.0224", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "5": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1580}, "6": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1614}, "7": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1539}, "8": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5f91a90ae14ae9b8b6fe51726c465074152fb5d1c9595ff18bd7d10fb4e9aa4", "output_hash": "e28a78bc4deb3cec8beab4bf5b87297d7cc55a3e6f839b43fe6408735d464923"} | |
| 6769 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "46afbea4c60193baf8eea7a5", "attempt_id": "319089f7e0f3", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:44.515038Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 514, "message_tokens": 411, "message_utf8_bytes": 1572, "cache_tensor_bytes": null, "serialized_payload_bytes": 1572, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 45646.34845801629, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444, "5": 5870.618999935687, "6": 5081.656874972396, "7": 5788.924874970689, "8": 4986.825458006933}, "receiver_prefill_ms": 210.16345801763237, "ttft_ms": 11.467749951407313, "decode_ms": 11.508374940603971}, "total_wall_ms": 45879.936957964674, "ttft_ms": 11.467749951407313, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "5": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1580}, "6": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1614}, "7": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1539}, "8": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5f91a90ae14ae9b8b6fe51726c465074152fb5d1c9595ff18bd7d10fb4e9aa4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6770 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "3312eb392bc296e3ac10ab47", "attempt_id": "d5f2e26ccdde", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:44.763625Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 521, "message_tokens": 411, "message_utf8_bytes": 1572, "cache_tensor_bytes": null, "serialized_payload_bytes": 1572, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 45646.34845801629, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444, "5": 5870.618999935687, "6": 5081.656874972396, "7": 5788.924874970689, "8": 4986.825458006933}, "receiver_prefill_ms": 209.93829099461436, "ttft_ms": 11.683167074806988, "decode_ms": 57.34379100613296}, "total_wall_ms": 45925.88841600809, "ttft_ms": 11.683167074806988, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,009,480", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "5": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1580}, "6": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1614}, "7": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1539}, "8": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5f91a90ae14ae9b8b6fe51726c465074152fb5d1c9595ff18bd7d10fb4e9aa4", "output_hash": "30b20d9aae4d7b0587edeefdc2a9a159f73faf6e2570f1d408a415fe92cbf45e"} | |
| 6771 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e256a24eea71bbf4a881837b", "attempt_id": "36f2f13fcba4", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:45.058104Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 523, "message_tokens": 411, "message_utf8_bytes": 1572, "cache_tensor_bytes": null, "serialized_payload_bytes": 1572, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 45646.34845801629, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444, "5": 5870.618999935687, "6": 5081.656874972396, "7": 5788.924874970689, "8": 4986.825458006933}, "receiver_prefill_ms": 210.05954209249467, "ttft_ms": 11.571915936656296, "decode_ms": 11.591000016778708}, "total_wall_ms": 45880.02587505616, "ttft_ms": 11.571915936656296, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "5": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1580}, "6": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1614}, "7": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1539}, "8": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5f91a90ae14ae9b8b6fe51726c465074152fb5d1c9595ff18bd7d10fb4e9aa4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6772 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "75d7c208ecc0cbc1720dbeff", "attempt_id": "99ba0830220b", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:45.307632Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 514, "message_tokens": 411, "message_utf8_bytes": 1572, "cache_tensor_bytes": null, "serialized_payload_bytes": 1572, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 45646.34845801629, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444, "5": 5870.618999935687, "6": 5081.656874972396, "7": 5788.924874970689, "8": 4986.825458006933}, "receiver_prefill_ms": 208.7915410520509, "ttft_ms": 11.58149994444102, "decode_ms": 23.20962504018098}, "total_wall_ms": 45890.458708046935, "ttft_ms": 11.58149994444102, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "5": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1580}, "6": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1614}, "7": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1539}, "8": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5f91a90ae14ae9b8b6fe51726c465074152fb5d1c9595ff18bd7d10fb4e9aa4", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | |
| 6773 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7ae6ce946411a5c966c8886a", "attempt_id": "6283746f5e33", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:45.566820Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 515, "message_tokens": 411, "message_utf8_bytes": 1572, "cache_tensor_bytes": null, "serialized_payload_bytes": 1572, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 45646.34845801629, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444, "5": 5870.618999935687, "6": 5081.656874972396, "7": 5788.924874970689, "8": 4986.825458006933}, "receiver_prefill_ms": 209.80845799203962, "ttft_ms": 11.496959021314979, "decode_ms": 23.185333935543895}, "total_wall_ms": 45891.29208307713, "ttft_ms": 11.496959021314979, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "5": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1580}, "6": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1614}, "7": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1539}, "8": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5f91a90ae14ae9b8b6fe51726c465074152fb5d1c9595ff18bd7d10fb4e9aa4", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | |
| 6774 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "fb7a0f959b5b9d9b4c6eb180", "attempt_id": "f453d08aedb8", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:45.826887Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 531, "message_tokens": 411, "message_utf8_bytes": 1572, "cache_tensor_bytes": null, "serialized_payload_bytes": 1572, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 45646.34845801629, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444, "5": 5870.618999935687, "6": 5081.656874972396, "7": 5788.924874970689, "8": 4986.825458006933}, "receiver_prefill_ms": 210.21349995862693, "ttft_ms": 11.583082959987223, "decode_ms": 11.523167020641267}, "total_wall_ms": 45880.12187497225, "ttft_ms": 11.583082959987223, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "5": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1580}, "6": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1614}, "7": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1539}, "8": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5f91a90ae14ae9b8b6fe51726c465074152fb5d1c9595ff18bd7d10fb4e9aa4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6775 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7a3e75e7ff0bdb49ad0e315c", "attempt_id": "d27eb5a714b2", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:46.075907Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 522, "message_tokens": 411, "message_utf8_bytes": 1572, "cache_tensor_bytes": null, "serialized_payload_bytes": 1572, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 45646.34845801629, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444, "5": 5870.618999935687, "6": 5081.656874972396, "7": 5788.924874970689, "8": 4986.825458006933}, "receiver_prefill_ms": 209.37204209621996, "ttft_ms": 11.538374936208129, "decode_ms": 11.743542039766908}, "total_wall_ms": 45879.43687499501, "ttft_ms": 11.538374936208129, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "5": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1580}, "6": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1614}, "7": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1539}, "8": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5f91a90ae14ae9b8b6fe51726c465074152fb5d1c9595ff18bd7d10fb4e9aa4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6776 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "369505830f6d0af79312068e", "attempt_id": "190ce7eef685", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:46.323965Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 531, "message_tokens": 411, "message_utf8_bytes": 1572, "cache_tensor_bytes": null, "serialized_payload_bytes": 1572, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 45646.34845801629, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444, "5": 5870.618999935687, "6": 5081.656874972396, "7": 5788.924874970689, "8": 4986.825458006933}, "receiver_prefill_ms": 210.2324590086937, "ttft_ms": 11.696124915033579, "decode_ms": 11.458582943305373}, "total_wall_ms": 45880.2797079552, "ttft_ms": 11.696124915033579, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "5": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1580}, "6": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1614}, "7": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1539}, "8": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5f91a90ae14ae9b8b6fe51726c465074152fb5d1c9595ff18bd7d10fb4e9aa4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6777 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "2a987097d1761c6472c2cf5b", "attempt_id": "fc19e8c1e03b", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:46.572734Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 526, "message_tokens": 411, "message_utf8_bytes": 1572, "cache_tensor_bytes": null, "serialized_payload_bytes": 1572, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 45646.34845801629, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444, "5": 5870.618999935687, "6": 5081.656874972396, "7": 5788.924874970689, "8": 4986.825458006933}, "receiver_prefill_ms": 209.68958304729313, "ttft_ms": 11.5634590620175, "decode_ms": 57.24787502549589}, "total_wall_ms": 45925.434957956895, "ttft_ms": 11.5634590620175, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "11,190,269", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "5": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1580}, "6": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1614}, "7": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1539}, "8": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5f91a90ae14ae9b8b6fe51726c465074152fb5d1c9595ff18bd7d10fb4e9aa4", "output_hash": "21023e2c5262695db33c4b4dfbf2ce40c8795742ceadf13db29509b3a088ad29"} | |
| 6778 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ef14f9fff8fa5f6f50021e7a", "attempt_id": "d425bcc14047", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:46.867226Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 522, "message_tokens": 411, "message_utf8_bytes": 1572, "cache_tensor_bytes": null, "serialized_payload_bytes": 1572, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 45646.34845801629, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444, "5": 5870.618999935687, "6": 5081.656874972396, "7": 5788.924874970689, "8": 4986.825458006933}, "receiver_prefill_ms": 210.1102079031989, "ttft_ms": 11.63962495047599, "decode_ms": 11.495582992210984}, "total_wall_ms": 45880.12345810421, "ttft_ms": 11.63962495047599, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "5": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1580}, "6": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1614}, "7": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1539}, "8": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5f91a90ae14ae9b8b6fe51726c465074152fb5d1c9595ff18bd7d10fb4e9aa4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6779 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "18cbbe38a8da5c961b6bd6a7", "attempt_id": "4e99f3b95af7", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:47.117226Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 526, "message_tokens": 411, "message_utf8_bytes": 1572, "cache_tensor_bytes": null, "serialized_payload_bytes": 1572, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 45646.34845801629, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444, "5": 5870.618999935687, "6": 5081.656874972396, "7": 5788.924874970689, "8": 4986.825458006933}, "receiver_prefill_ms": 210.20649990532547, "ttft_ms": 11.656583985313773, "decode_ms": 11.594834038987756}, "total_wall_ms": 45880.25770802051, "ttft_ms": 11.656583985313773, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "5": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1580}, "6": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1614}, "7": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1539}, "8": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5f91a90ae14ae9b8b6fe51726c465074152fb5d1c9595ff18bd7d10fb4e9aa4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6780 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5282996b8e943c58145fdb3b", "attempt_id": "d438d80378fa", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:47.366819Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 528, "message_tokens": 411, "message_utf8_bytes": 1572, "cache_tensor_bytes": null, "serialized_payload_bytes": 1572, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 45646.34845801629, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444, "5": 5870.618999935687, "6": 5081.656874972396, "7": 5788.924874970689, "8": 4986.825458006933}, "receiver_prefill_ms": 210.3344580391422, "ttft_ms": 11.54904195573181, "decode_ms": 11.54974999371916}, "total_wall_ms": 45880.225665983744, "ttft_ms": 11.54904195573181, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "5": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1580}, "6": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1614}, "7": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1539}, "8": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5f91a90ae14ae9b8b6fe51726c465074152fb5d1c9595ff18bd7d10fb4e9aa4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6781 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7ea68c21988e6c3e307fe98a", "attempt_id": "61760789fca4", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:54.560642Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 440, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6942.490917048417, "hops": {"1": 6942.490917048417}, "receiver_prefill_ms": 164.17279106099159, "ttft_ms": 11.82345801498741, "decode_ms": 11.827292037196457}, "total_wall_ms": 7130.719625158235, "ttft_ms": 11.82345801498741, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6782 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b50913f2e4efe90df7866026", "attempt_id": "82e4e40bbb30", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:54.765287Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 445, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6942.490917048417, "hops": {"1": 6942.490917048417}, "receiver_prefill_ms": 164.5389589248225, "ttft_ms": 11.915499926544726, "decode_ms": 129.21375001315027}, "total_wall_ms": 7248.639875091612, "ttft_ms": 11.915499926544726, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 568-G in Mont-Laurier", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.5}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "98e007faa5a10742ad74f2778a64e3ea0d6b72bec1c0392200d475073d7bf082"} | |
| 6783 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "40ff4ba3875193852fcc2869", "attempt_id": "e84b4dbfc5db", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:55.087199Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 445, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6942.490917048417, "hops": {"1": 6942.490917048417}, "receiver_prefill_ms": 164.58516696002334, "ttft_ms": 11.787749943323433, "decode_ms": 11.765792034566402}, "total_wall_ms": 7131.01237511728, "ttft_ms": 11.787749943323433, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6784 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "cdf26439619bebeaab3e4c6e", "attempt_id": "54c0db6df4e6", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:55.291190Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 440, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6942.490917048417, "hops": {"1": 6942.490917048417}, "receiver_prefill_ms": 164.17929204180837, "ttft_ms": 12.010416015982628, "decode_ms": 11.781290988437831}, "total_wall_ms": 7130.971959093586, "ttft_ms": 12.010416015982628, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6785 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "23b9f866e5e5c1b8cbc29935", "attempt_id": "359d82465c6e", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:55.495093Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 446, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6942.490917048417, "hops": {"1": 6942.490917048417}, "receiver_prefill_ms": 165.33824999351054, "ttft_ms": 11.931874905712903, "decode_ms": 11.804083944298327}, "total_wall_ms": 7132.061625015922, "ttft_ms": 11.931874905712903, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6786 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "1930788d821a20e147f1ef40", "attempt_id": "5beaf27ef6dc", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:55.701211Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 450, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6942.490917048417, "hops": {"1": 6942.490917048417}, "receiver_prefill_ms": 185.3592919651419, "ttft_ms": 11.888915905728936, "decode_ms": 11.97108393535018}, "total_wall_ms": 7152.126542059705, "ttft_ms": 11.888915905728936, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6787 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0c0133b9c689e9d857481420", "attempt_id": "fb008591de2f", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:55.926782Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 439, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6942.490917048417, "hops": {"1": 6942.490917048417}, "receiver_prefill_ms": 164.45625002961606, "ttft_ms": 11.807958013378084, "decode_ms": 11.83654204942286}, "total_wall_ms": 7130.97204209771, "ttft_ms": 11.807958013378084, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | |
| 6788 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "54df357d5a8f2d4e93433bfa", "attempt_id": "4bcd26fae1b5", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:56.130611Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 441, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6942.490917048417, "hops": {"1": 6942.490917048417}, "receiver_prefill_ms": 164.52458291314542, "ttft_ms": 11.794665944762528, "decode_ms": 11.808041017502546}, "total_wall_ms": 7130.982834030874, "ttft_ms": 11.794665944762528, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | |
| 6789 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5d70de1e7a817eb1353daa2a", "attempt_id": "832f12926bc9", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:56.334131Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 457, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6942.490917048417, "hops": {"1": 6942.490917048417}, "receiver_prefill_ms": 185.8098329976201, "ttft_ms": 11.822375003248453, "decode_ms": 11.8561249691993}, "total_wall_ms": 7152.3516670567915, "ttft_ms": 11.822375003248453, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6790 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e362aa75542bd746776f0c73", "attempt_id": "410b5f7e4587", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:56.558788Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 448, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6942.490917048417, "hops": {"1": 6942.490917048417}, "receiver_prefill_ms": 165.33612494822592, "ttft_ms": 11.832375079393387, "decode_ms": 82.35804201103747}, "total_wall_ms": 7202.369041973725, "ttft_ms": 11.832375079393387, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "9134435", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "f7384892cb4f9a38f6115f91da5fec3f0d7e24e47877737b0f34e2b4a6af7d5a"} | |
| 6791 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c98d98199120f34f8827f16d", "attempt_id": "d490e7b827d5", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:56.833980Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 458, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6942.490917048417, "hops": {"1": 6942.490917048417}, "receiver_prefill_ms": 185.3366669965908, "ttft_ms": 12.078124913387, "decode_ms": 11.815457954071462}, "total_wall_ms": 7152.1960840327665, "ttft_ms": 12.078124913387, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6792 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7f1663034de9f6aba686ce64", "attempt_id": "2e1ae2e964a8", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:57.059192Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 451, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6942.490917048417, "hops": {"1": 6942.490917048417}, "receiver_prefill_ms": 185.3935410035774, "ttft_ms": 11.88008300960064, "decode_ms": 82.08512503188103}, "total_wall_ms": 7222.34874998685, "ttft_ms": 11.88008300960064, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8066734", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "167c75fdd6a41fca64228797ab8f3a1a3f994475246df0bffb2e060d5d2e4ff0"} | |
| 6793 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "04c8079f8fa3824a466c287a", "attempt_id": "d5cbd328b5ff", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:57.354591Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 448, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6942.490917048417, "hops": {"1": 6942.490917048417}, "receiver_prefill_ms": 164.56816694699228, "ttft_ms": 12.100499938242137, "decode_ms": 11.922874953597784}, "total_wall_ms": 7131.640583975241, "ttft_ms": 12.100499938242137, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6794 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "417e157d94e0e3154c9c7cd6", "attempt_id": "bd2ab830ed00", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:57.559883Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 452, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6942.490917048417, "hops": {"1": 6942.490917048417}, "receiver_prefill_ms": 185.2195409592241, "ttft_ms": 12.060333974659443, "decode_ms": 11.880666948854923}, "total_wall_ms": 7152.249751030467, "ttft_ms": 12.060333974659443, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6795 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b840b5a8a2bea799e19e3f8f", "attempt_id": "9a3f0b9d305d", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:57.786959Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 453, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6942.490917048417, "hops": {"1": 6942.490917048417}, "receiver_prefill_ms": 185.63199997879565, "ttft_ms": 11.94083399605006, "decode_ms": 11.851874995045364}, "total_wall_ms": 7152.419749996625, "ttft_ms": 11.94083399605006, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6796 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "3765388b04f031b28489e005", "attempt_id": "a71aa6b7eb29", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:01.971893Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 426, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10900.45654203277, "hops": {"1": 6942.490917048417, "2": 3957.965624984354}, "receiver_prefill_ms": 183.02712496370077, "ttft_ms": 11.487290961667895, "decode_ms": 11.496416991576552}, "total_wall_ms": 11106.89208295662, "ttft_ms": 11.487290961667895, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6797 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "02167f383d66e8cf77d7fdb9", "attempt_id": "3d5e86716d1f", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:02.194376Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 431, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10900.45654203277, "hops": {"1": 6942.490917048417, "2": 3957.965624984354}, "receiver_prefill_ms": 183.27483301982284, "ttft_ms": 11.460541049018502, "decode_ms": 11.465542018413544}, "total_wall_ms": 11107.04320797231, "ttft_ms": 11.460541049018502, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6798 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f52f453ce41971920a155afc", "attempt_id": "1a4648b7f9c8", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:02.416316Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 431, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10900.45654203277, "hops": {"1": 6942.490917048417, "2": 3957.965624984354}, "receiver_prefill_ms": 187.6737920101732, "ttft_ms": 11.563832988031209, "decode_ms": 11.674916953779757}, "total_wall_ms": 11111.748209106736, "ttft_ms": 11.563832988031209, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6799 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f94e6b903be994776c463660", "attempt_id": "a4e81ef944e2", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:02.643020Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 426, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10900.45654203277, "hops": {"1": 6942.490917048417, "2": 3957.965624984354}, "receiver_prefill_ms": 181.05399992782623, "ttft_ms": 11.5665839985013, "decode_ms": 11.42991695087403}, "total_wall_ms": 11104.8718750244, "ttft_ms": 11.5665839985013, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6800 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "2c82fa120f3bc17680c45643", "attempt_id": "a2dcd8d19210", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:02.862162Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 433, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10900.45654203277, "hops": {"1": 6942.490917048417, "2": 3957.965624984354}, "receiver_prefill_ms": 186.2979590659961, "ttft_ms": 11.589249945245683, "decode_ms": 11.464667040854692}, "total_wall_ms": 11110.232583014295, "ttft_ms": 11.589249945245683, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6801 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0b6911b723a0a6d66f439ed0", "attempt_id": "38f74865ed67", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:03.087265Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 435, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10900.45654203277, "hops": {"1": 6942.490917048417, "2": 3957.965624984354}, "receiver_prefill_ms": 188.05520795285702, "ttft_ms": 11.52770803309977, "decode_ms": 11.488832999020815}, "total_wall_ms": 11111.909626051784, "ttft_ms": 11.52770803309977, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6802 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "74408db948005691fd67cf2f", "attempt_id": "179a25fa3c47", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:03.314314Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 426, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10900.45654203277, "hops": {"1": 6942.490917048417, "2": 3957.965624984354}, "receiver_prefill_ms": 182.77116701938212, "ttft_ms": 11.77541702054441, "decode_ms": 11.436625034548342}, "total_wall_ms": 11106.801541987807, "ttft_ms": 11.77541702054441, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | |
| 6803 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a46ba1327729fe935236eda5", "attempt_id": "1dded563a49c", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:03.535427Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 427, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10900.45654203277, "hops": {"1": 6942.490917048417, "2": 3957.965624984354}, "receiver_prefill_ms": 183.2695419434458, "ttft_ms": 11.47595897782594, "decode_ms": 11.704165954142809}, "total_wall_ms": 11107.27700102143, "ttft_ms": 11.47595897782594, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | |
| 6804 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "3110b0e89708c09b55470ecf", "attempt_id": "36a6c8ab9f4d", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:03.757378Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 443, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10900.45654203277, "hops": {"1": 6942.490917048417, "2": 3957.965624984354}, "receiver_prefill_ms": 186.68641697149724, "ttft_ms": 11.72691595274955, "decode_ms": 11.568082962185144}, "total_wall_ms": 11110.898167011328, "ttft_ms": 11.72691595274955, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6805 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "80771fd8fc01a8494cf3e917", "attempt_id": "865cf39c2408", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:03.982572Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 434, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10900.45654203277, "hops": {"1": 6942.490917048417, "2": 3957.965624984354}, "receiver_prefill_ms": 185.10508292820305, "ttft_ms": 11.534375022165477, "decode_ms": 11.476874933578074}, "total_wall_ms": 11108.943209052086, "ttft_ms": 11.534375022165477, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6806 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ab9c0812bc1e5975c3077779", "attempt_id": "82966a7c33a8", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:04.206904Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 443, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10900.45654203277, "hops": {"1": 6942.490917048417, "2": 3957.965624984354}, "receiver_prefill_ms": 184.13154198788106, "ttft_ms": 11.771833058446646, "decode_ms": 11.547999922186136}, "total_wall_ms": 11108.296750113368, "ttft_ms": 11.771833058446646, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6807 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "2313839625baddfb110a28b1", "attempt_id": "9835423d86ce", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:04.429592Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 438, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10900.45654203277, "hops": {"1": 6942.490917048417, "2": 3957.965624984354}, "receiver_prefill_ms": 183.85466700419784, "ttft_ms": 11.49316702503711, "decode_ms": 57.294458034448326}, "total_wall_ms": 11153.48612505477, "ttft_ms": 11.49316702503711, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8,066,734", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "dc9cab51923d7bfcae06d683e0d005a1575296aa981b1594b358ff8e12cd8aa2"} | |
| 6808 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "34a7ad34fb6e6579a2a680ba", "attempt_id": "7db5b64893bb", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:04.697315Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 434, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10900.45654203277, "hops": {"1": 6942.490917048417, "2": 3957.965624984354}, "receiver_prefill_ms": 181.80583301000297, "ttft_ms": 11.380832991562784, "decode_ms": 11.359915952198207}, "total_wall_ms": 11105.435084085912, "ttft_ms": 11.380832991562784, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6809 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5cab9bb8fcc30736863eaa8a", "attempt_id": "adbce4bc2b9a", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:04.917535Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 438, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10900.45654203277, "hops": {"1": 6942.490917048417, "2": 3957.965624984354}, "receiver_prefill_ms": 183.6892500286922, "ttft_ms": 11.75812492147088, "decode_ms": 11.59737491980195}, "total_wall_ms": 11108.054375974461, "ttft_ms": 11.75812492147088, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6810 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "3af432d259e3bca11790a66c", "attempt_id": "0388347f07e1", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:05.141625Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 440, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10900.45654203277, "hops": {"1": 6942.490917048417, "2": 3957.965624984354}, "receiver_prefill_ms": 184.25258295610547, "ttft_ms": 11.788749950937927, "decode_ms": 11.493749916553497}, "total_wall_ms": 11108.51729195565, "ttft_ms": 11.788749950937927, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6811 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "6e3620e341e5f19190427c2a", "attempt_id": "c589a63df051", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:13.983520Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 426, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 19514.309624908492, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781}, "receiver_prefill_ms": 184.1999579919502, "ttft_ms": 11.594541021622717, "decode_ms": 11.508165975101292}, "total_wall_ms": 19722.014916944318, "ttft_ms": 11.594541021622717, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6812 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "341398af21254299fd05432c", "attempt_id": "e87eb141ab39", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:14.207464Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 431, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 19514.309624908492, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781}, "receiver_prefill_ms": 181.44158297218382, "ttft_ms": 11.374584049917758, "decode_ms": 11.39879203401506}, "total_wall_ms": 19718.946166918613, "ttft_ms": 11.374584049917758, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6813 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "8ea130f623cb39142ed4abc7", "attempt_id": "426194313c55", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:14.427675Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 431, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 19514.309624908492, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781}, "receiver_prefill_ms": 182.22395901102573, "ttft_ms": 11.67129201348871, "decode_ms": 11.588084045797586}, "total_wall_ms": 19720.284540904686, "ttft_ms": 11.67129201348871, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6814 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "483c4c81d9e0a199d7040350", "attempt_id": "fabb6e48b401", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:14.650090Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 426, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 19514.309624908492, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781}, "receiver_prefill_ms": 183.7006249697879, "ttft_ms": 11.6478749550879, "decode_ms": 11.421707924455404}, "total_wall_ms": 19721.45666682627, "ttft_ms": 11.6478749550879, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6815 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "8ac08b5146a1444ed44eceed", "attempt_id": "739d48ad990f", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:14.872852Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 433, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 19514.309624908492, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781}, "receiver_prefill_ms": 184.29208302404732, "ttft_ms": 11.762207956053317, "decode_ms": 11.552499956451356}, "total_wall_ms": 19722.280749934725, "ttft_ms": 11.762207956053317, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6816 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5a0be8a9e3fcf17d9d150608", "attempt_id": "cdcb8c8c491c", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:15.096165Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 435, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 19514.309624908492, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781}, "receiver_prefill_ms": 183.27404104638845, "ttft_ms": 11.543708038516343, "decode_ms": 11.734125087969005}, "total_wall_ms": 19721.227041911334, "ttft_ms": 11.543708038516343, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6817 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5f743a995d01fdf85b468378", "attempt_id": "e09d04d580e2", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:15.318041Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 426, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 19514.309624908492, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781}, "receiver_prefill_ms": 182.8124999301508, "ttft_ms": 11.591291055083275, "decode_ms": 11.483666021376848}, "total_wall_ms": 19720.546958851628, "ttft_ms": 11.591291055083275, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | |
| 6818 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "927b79ffdb1963ca4e10d658", "attempt_id": "44aabd13aa1a", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:15.539613Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 427, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 19514.309624908492, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781}, "receiver_prefill_ms": 183.50520904641598, "ttft_ms": 11.576459044590592, "decode_ms": 11.547417030669749}, "total_wall_ms": 19721.285083913244, "ttft_ms": 11.576459044590592, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | |
| 6819 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "57c7f9d0e47ccd7281b791a9", "attempt_id": "49e820a8cbe8", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:15.760995Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 443, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 19514.309624908492, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781}, "receiver_prefill_ms": 185.54966698866338, "ttft_ms": 11.717541958205402, "decode_ms": 11.486334027722478}, "total_wall_ms": 19723.56299997773, "ttft_ms": 11.717541958205402, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6820 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ecad42e6593cb2bb3039820e", "attempt_id": "80eb3587ba88", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:15.984777Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 434, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 19514.309624908492, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781}, "receiver_prefill_ms": 183.88687493279576, "ttft_ms": 11.714499909430742, "decode_ms": 11.591916088946164}, "total_wall_ms": 19721.97991691064, "ttft_ms": 11.714499909430742, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6821 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "55580b0dd5cc4d278dd95af6", "attempt_id": "a2a15e8a51f4", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:16.208789Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 443, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 19514.309624908492, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781}, "receiver_prefill_ms": 183.63045796286315, "ttft_ms": 11.513874982483685, "decode_ms": 11.528540984727442}, "total_wall_ms": 19721.35595791042, "ttft_ms": 11.513874982483685, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6822 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "8f08cbdd34b9bc51dbbee7b9", "attempt_id": "ee87677406ad", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:16.431465Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 438, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 19514.309624908492, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781}, "receiver_prefill_ms": 184.42091590259224, "ttft_ms": 11.530417017638683, "decode_ms": 57.694667018949986}, "total_wall_ms": 19768.310999847017, "ttft_ms": 11.530417017638683, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8,066,734", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "dc9cab51923d7bfcae06d683e0d005a1575296aa981b1594b358ff8e12cd8aa2"} | |
| 6823 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "6a29544c45d697374848293b", "attempt_id": "6b5c885dec96", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:16.700159Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 434, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 19514.309624908492, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781}, "receiver_prefill_ms": 184.90699992980808, "ttft_ms": 11.957417009398341, "decode_ms": 11.740165995433927}, "total_wall_ms": 19723.47149986308, "ttft_ms": 11.957417009398341, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6824 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "37b13692712397bfb9969bdd", "attempt_id": "4ee39ef4a927", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:16.924776Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 438, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 19514.309624908492, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781}, "receiver_prefill_ms": 181.35991704184562, "ttft_ms": 11.548041016794741, "decode_ms": 11.508374940603971}, "total_wall_ms": 19719.093291903846, "ttft_ms": 11.548041016794741, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6825 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0c07d95ce1c0fdcfcc593ccb", "attempt_id": "15207700b686", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:17.146310Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 440, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 19514.309624908492, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781}, "receiver_prefill_ms": 184.65470790397376, "ttft_ms": 11.542166932485998, "decode_ms": 11.513334000483155}, "total_wall_ms": 19722.375583834946, "ttft_ms": 11.542166932485998, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6826 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "39e2a6f143e6938c0c3db118", "attempt_id": "09f2a992287b", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:34.649674Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 426, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36789.773125899956, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781, "5": 4663.1102920509875, "6": 3976.8799169687554, "7": 4664.292625035159, "8": 3971.1806669365615}, "receiver_prefill_ms": 183.08550002984703, "ttft_ms": 11.601291946135461, "decode_ms": 11.484125046990812}, "total_wall_ms": 36996.3697087951, "ttft_ms": 11.601291946135461, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6827 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "899c3af9a862ddf9b1c9041f", "attempt_id": "50e48687a91f", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:34.872670Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 431, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36789.773125899956, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781, "5": 4663.1102920509875, "6": 3976.8799169687554, "7": 4664.292625035159, "8": 3971.1806669365615}, "receiver_prefill_ms": 182.90829204488546, "ttft_ms": 11.730083962902427, "decode_ms": 11.43295899964869}, "total_wall_ms": 36996.33025098592, "ttft_ms": 11.730083962902427, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6828 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "8b2082f56337184cddfcab15", "attempt_id": "81493b7edde7", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:35.094787Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 431, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36789.773125899956, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781, "5": 4663.1102920509875, "6": 3976.8799169687554, "7": 4664.292625035159, "8": 3971.1806669365615}, "receiver_prefill_ms": 185.24195801001042, "ttft_ms": 11.776624945923686, "decode_ms": 11.558542028069496}, "total_wall_ms": 36998.90954291914, "ttft_ms": 11.776624945923686, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6829 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "bef343ba48fd744c7b5dbff5", "attempt_id": "1d8241ac7869", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:35.319566Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 426, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36789.773125899956, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781, "5": 4663.1102920509875, "6": 3976.8799169687554, "7": 4664.292625035159, "8": 3971.1806669365615}, "receiver_prefill_ms": 184.03991602826864, "ttft_ms": 11.676999973133206, "decode_ms": 11.541791958734393}, "total_wall_ms": 36997.526583843865, "ttft_ms": 11.676999973133206, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6830 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "443e892f11ce691c38d53866", "attempt_id": "0e754a5883fc", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:35.544813Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 433, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36789.773125899956, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781, "5": 4663.1102920509875, "6": 3976.8799169687554, "7": 4664.292625035159, "8": 3971.1806669365615}, "receiver_prefill_ms": 185.23162510246038, "ttft_ms": 11.700915987603366, "decode_ms": 11.60245796199888}, "total_wall_ms": 36998.68741782848, "ttft_ms": 11.700915987603366, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6831 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b9c8f02f284f8c808bf7cb73", "attempt_id": "85dee5f358ed", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:35.768737Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 435, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36789.773125899956, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781, "5": 4663.1102920509875, "6": 3976.8799169687554, "7": 4664.292625035159, "8": 3971.1806669365615}, "receiver_prefill_ms": 184.88633399829268, "ttft_ms": 11.612833011895418, "decode_ms": 11.551167001016438}, "total_wall_ms": 36998.181041912176, "ttft_ms": 11.612833011895418, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6832 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "31988c7fcdb04eae184ef6e0", "attempt_id": "244405cfe9ab", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:35.992030Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 426, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36789.773125899956, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781, "5": 4663.1102920509875, "6": 3976.8799169687554, "7": 4664.292625035159, "8": 3971.1806669365615}, "receiver_prefill_ms": 183.257416007109, "ttft_ms": 11.537457932718098, "decode_ms": 11.523457942530513}, "total_wall_ms": 36996.444708900526, "ttft_ms": 11.537457932718098, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | |
| 6833 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "dd4f984fd246a4b0a43721c4", "attempt_id": "ece20b68d2c4", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:36.213603Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 427, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36789.773125899956, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781, "5": 4663.1102920509875, "6": 3976.8799169687554, "7": 4664.292625035159, "8": 3971.1806669365615}, "receiver_prefill_ms": 183.06658300571144, "ttft_ms": 11.994833941571414, "decode_ms": 11.570833972655237}, "total_wall_ms": 36996.86645891052, "ttft_ms": 11.994833941571414, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | |
| 6834 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "820d76ff89aac2a575b498a1", "attempt_id": "2e04488afea4", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:36.435516Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 443, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36789.773125899956, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781, "5": 4663.1102920509875, "6": 3976.8799169687554, "7": 4664.292625035159, "8": 3971.1806669365615}, "receiver_prefill_ms": 183.62854199949652, "ttft_ms": 11.598541983403265, "decode_ms": 11.552541982382536}, "total_wall_ms": 36996.93225091323, "ttft_ms": 11.598541983403265, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6835 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b00e6a1b7f83f6c0def836b4", "attempt_id": "a54bd0e3c2f1", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:36.658381Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 434, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36789.773125899956, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781, "5": 4663.1102920509875, "6": 3976.8799169687554, "7": 4664.292625035159, "8": 3971.1806669365615}, "receiver_prefill_ms": 185.11045794002712, "ttft_ms": 11.474458035081625, "decode_ms": 11.570999980904162}, "total_wall_ms": 36998.308541835286, "ttft_ms": 11.474458035081625, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6836 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "dfcd2d188fe0e7d04babc79c", "attempt_id": "0fffbdbf5ba7", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:36.882133Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 443, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36789.773125899956, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781, "5": 4663.1102920509875, "6": 3976.8799169687554, "7": 4664.292625035159, "8": 3971.1806669365615}, "receiver_prefill_ms": 185.32691604923457, "ttft_ms": 11.628582957200706, "decode_ms": 11.593833100050688}, "total_wall_ms": 36998.779916903004, "ttft_ms": 11.628582957200706, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6837 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7675354915ddcee787617f38", "attempt_id": "addda394f4c3", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:37.105901Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 438, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36789.773125899956, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781, "5": 4663.1102920509875, "6": 3976.8799169687554, "7": 4664.292625035159, "8": 3971.1806669365615}, "receiver_prefill_ms": 183.45025007147342, "ttft_ms": 11.538333958014846, "decode_ms": 57.53012502100319}, "total_wall_ms": 37042.65787592158, "ttft_ms": 11.538333958014846, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8,066,734", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "dc9cab51923d7bfcae06d683e0d005a1575296aa981b1594b358ff8e12cd8aa2"} | |
| 6838 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a4702798a9616e99b3f21f59", "attempt_id": "0a5ee6adbe1f", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:37.374216Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 434, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36789.773125899956, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781, "5": 4663.1102920509875, "6": 3976.8799169687554, "7": 4664.292625035159, "8": 3971.1806669365615}, "receiver_prefill_ms": 182.42191604804248, "ttft_ms": 11.514583951793611, "decode_ms": 11.424958007410169}, "total_wall_ms": 36995.47787592746, "ttft_ms": 11.514583951793611, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6839 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "63bb4d730073f8a8136a1dc0", "attempt_id": "957543e372b8", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:37.595047Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 438, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36789.773125899956, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781, "5": 4663.1102920509875, "6": 3976.8799169687554, "7": 4664.292625035159, "8": 3971.1806669365615}, "receiver_prefill_ms": 181.93808302748948, "ttft_ms": 12.016542023047805, "decode_ms": 11.811875039711595}, "total_wall_ms": 36996.139541850425, "ttft_ms": 12.016542023047805, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6840 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "225263431e070ab46a7e57fd", "attempt_id": "ce874528b8ff", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:37.816687Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 440, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36789.773125899956, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781, "5": 4663.1102920509875, "6": 3976.8799169687554, "7": 4664.292625035159, "8": 3971.1806669365615}, "receiver_prefill_ms": 185.19450002349913, "ttft_ms": 11.919625103473663, "decode_ms": 11.719666887074709}, "total_wall_ms": 36999.187958892435, "ttft_ms": 11.919625103473663, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6841 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "66572425c7034fc4285d7b51", "attempt_id": "2e86bc484468", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:45.020626Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 594, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.277834079228, "hops": {"1": 6896.277834079228}, "receiver_prefill_ms": 227.18162497039884, "ttft_ms": 11.884292005561292, "decode_ms": 11.968541075475514}, "total_wall_ms": 7147.845167084597, "ttft_ms": 11.884292005561292, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6842 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a505875f1d4297785d2b1c75", "attempt_id": "0feb6491173b", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:45.288112Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 601, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.277834079228, "hops": {"1": 6896.277834079228}, "receiver_prefill_ms": 227.2848329739645, "ttft_ms": 11.879250057972968, "decode_ms": 143.36750004440546}, "total_wall_ms": 7279.33433407452, "ttft_ms": 11.879250057972968, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 12}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 247-S, Baie-Comeau", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "77b7da1d43e7d8815e9e9159ebbd735045bc7f668260ba30b93674f70622b8ec"} | |
| 6843 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "2e82ba4be7c3551d233bae4a", "attempt_id": "fd9ec5061d83", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:45.686474Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.277834079228, "hops": {"1": 6896.277834079228}, "receiver_prefill_ms": 226.71499999705702, "ttft_ms": 12.005083030089736, "decode_ms": 83.47604202572256}, "total_wall_ms": 7219.073334126733, "ttft_ms": 12.005083030089736, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "15.0054", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "d13adba73068c847c850237059e0202fc5b91ccacf2e792e9ce5e3b90556501a"} | |
| 6844 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "2663feb6b3806e15db462141", "attempt_id": "4a68814f482c", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:46.024752Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.277834079228, "hops": {"1": 6896.277834079228}, "receiver_prefill_ms": 227.24654199555516, "ttft_ms": 11.966542107984424, "decode_ms": 107.16783395037055}, "total_wall_ms": 7243.166626081802, "ttft_ms": 11.966542107984424, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Priyamvada Sørlie", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "c5f554196ed23dd71ad995ec89f7142099d524dbb6534cc10d94a0c89d13e792"} | |
| 6845 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "1958547f71b8ddf37f656406", "attempt_id": "1a46ec016340", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:46.387524Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.277834079228, "hops": {"1": 6896.277834079228}, "receiver_prefill_ms": 227.36379189882427, "ttft_ms": 12.000042013823986, "decode_ms": 11.930583976209164}, "total_wall_ms": 7148.120459052734, "ttft_ms": 12.000042013823986, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6846 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "902f6c62c96e48069f943197", "attempt_id": "b1ccca241cdd", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:46.654816Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.277834079228, "hops": {"1": 6896.277834079228}, "receiver_prefill_ms": 227.08666697144508, "ttft_ms": 11.93825004156679, "decode_ms": 11.94079197011888}, "total_wall_ms": 7147.7413760731, "ttft_ms": 11.93825004156679, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6847 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "576887d7bdeaf2bc4e7b4398", "attempt_id": "8dca5f79eb36", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:46.921605Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.277834079228, "hops": {"1": 6896.277834079228}, "receiver_prefill_ms": 226.9028329756111, "ttft_ms": 11.929624946787953, "decode_ms": 11.902374913915992}, "total_wall_ms": 7147.443876019679, "ttft_ms": 11.929624946787953, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6848 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "de4b312c2dede396a1a34597", "attempt_id": "1f8bac3b7bd1", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:47.187621Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 596, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.277834079228, "hops": {"1": 6896.277834079228}, "receiver_prefill_ms": 227.014834061265, "ttft_ms": 12.189500033855438, "decode_ms": 12.008458958007395}, "total_wall_ms": 7148.10291712638, "ttft_ms": 12.189500033855438, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | |
| 6849 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "af04aeaebaa092508d102f44", "attempt_id": "36e81c844352", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:47.454980Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 610, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.277834079228, "hops": {"1": 6896.277834079228}, "receiver_prefill_ms": 229.73904199898243, "ttft_ms": 11.996667017228901, "decode_ms": 83.51000002585351}, "total_wall_ms": 7222.080167150125, "ttft_ms": 11.996667017228901, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8010205", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "6d1ceb36132f38bd77e8f46c23ea21dd9bcff78bc80bd8a9eaf2d7f2f3bacf46"} | |
| 6850 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c0ee52d6b9cc2e3be3a2d06d", "attempt_id": "d2437f21e50a", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:47.796422Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.277834079228, "hops": {"1": 6896.277834079228}, "receiver_prefill_ms": 226.97950003203005, "ttft_ms": 11.93766703363508, "decode_ms": 107.30429191607982}, "total_wall_ms": 7242.995709064417, "ttft_ms": 11.93766703363508, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,056,150", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "8262889a8478c7e0ee965f159d9849a3849b412e276f5b979476e2da5b320249"} | |
| 6851 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "59b9ff8b13d556d357c09d32", "attempt_id": "4dd5657b5038", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:48.158347Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 613, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.277834079228, "hops": {"1": 6896.277834079228}, "receiver_prefill_ms": 229.18437502812594, "ttft_ms": 11.881874990649521, "decode_ms": 83.33941700402647}, "total_wall_ms": 7221.206209156662, "ttft_ms": 11.881874990649521, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lunlith-13", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "c45f000afe6d865c8167954eebdff761141225817d4f5b26c962cd50cd75d391"} | |
| 6852 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e44219fd3fa6f41965c4458a", "attempt_id": "ad4dbca8b42d", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:48.498213Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.277834079228, "hops": {"1": 6896.277834079228}, "receiver_prefill_ms": 227.49158297665417, "ttft_ms": 11.954542016610503, "decode_ms": 119.40641701221466}, "total_wall_ms": 7255.645459052175, "ttft_ms": 11.954542016610503, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "23,450,077", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "2044d7c4afd32892ac22705680e35174db83308c139b02a1494275cc5e24aff3"} | |
| 6853 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "94e171be9d7fba83905b3a10", "attempt_id": "406fb3f0385a", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:48.873002Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.277834079228, "hops": {"1": 6896.277834079228}, "receiver_prefill_ms": 226.21345799416304, "ttft_ms": 12.138666934333742, "decode_ms": 11.895625037141144}, "total_wall_ms": 7147.149959113449, "ttft_ms": 12.138666934333742, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6854 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "1bf57ae1ad924ff10170ec6c", "attempt_id": "a03914bdc8b1", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:49.139135Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.277834079228, "hops": {"1": 6896.277834079228}, "receiver_prefill_ms": 226.58466605935246, "ttft_ms": 12.026333017274737, "decode_ms": 11.8740409379825}, "total_wall_ms": 7147.256001015194, "ttft_ms": 12.026333017274737, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6855 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "8903790c81721835f22e455b", "attempt_id": "753fac8761e6", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:49.405855Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 608, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.277834079228, "hops": {"1": 6896.277834079228}, "receiver_prefill_ms": 226.44899995066226, "ttft_ms": 12.065957998856902, "decode_ms": 12.056792038492858}, "total_wall_ms": 7147.501792060211, "ttft_ms": 12.065957998856902, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6856 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "380461c99b1dd78a93896e5a", "attempt_id": "183d164b05e1", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:56.046438Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 594, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13268.967709154822, "hops": {"1": 6896.277834079228, "2": 6372.689875075594}, "receiver_prefill_ms": 226.353875012137, "ttft_ms": 11.964041041210294, "decode_ms": 11.987666017375886}, "total_wall_ms": 13519.761501112953, "ttft_ms": 11.964041041210294, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6857 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "bb672f0d17e1dce0f73b2bfe", "attempt_id": "bc487cb70976", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:56.313252Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 601, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13268.967709154822, "hops": {"1": 6896.277834079228, "2": 6372.689875075594}, "receiver_prefill_ms": 226.6314160078764, "ttft_ms": 11.946083046495914, "decode_ms": 142.85629207734019}, "total_wall_ms": 13650.942834210582, "ttft_ms": 11.946083046495914, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 12}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 247-S, Baie-Comeau", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "77b7da1d43e7d8815e9e9159ebbd735045bc7f668260ba30b93674f70622b8ec"} | |
| 6858 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "2f42ac5d2c84d2ded643b7b8", "attempt_id": "1ff8956d4f1e", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:56.710422Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13268.967709154822, "hops": {"1": 6896.277834079228, "2": 6372.689875075594}, "receiver_prefill_ms": 226.8895839806646, "ttft_ms": 11.947875027544796, "decode_ms": 83.42229202389717}, "total_wall_ms": 13591.716709081084, "ttft_ms": 11.947875027544796, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "15.0054", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "d13adba73068c847c850237059e0202fc5b91ccacf2e792e9ce5e3b90556501a"} | |
| 6859 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "96f79ccf45bf13aa8e20f958", "attempt_id": "207e91b6d37a", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:57.049391Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13268.967709154822, "hops": {"1": 6896.277834079228, "2": 6372.689875075594}, "receiver_prefill_ms": 226.73004202079028, "ttft_ms": 11.906833969987929, "decode_ms": 106.80929094087332}, "total_wall_ms": 13614.928168128245, "ttft_ms": 11.906833969987929, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Priyamvada Sørlie", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "c5f554196ed23dd71ad995ec89f7142099d524dbb6534cc10d94a0c89d13e792"} | |
| 6860 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "02be1f189f0e83e046ada8a0", "attempt_id": "67e0ed26a09d", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:57.410889Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13268.967709154822, "hops": {"1": 6896.277834079228, "2": 6372.689875075594}, "receiver_prefill_ms": 226.68625006917864, "ttft_ms": 12.129915994592011, "decode_ms": 11.946541024371982}, "total_wall_ms": 13520.36462619435, "ttft_ms": 12.129915994592011, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6861 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4f9b895e9fe6ba03ced05886", "attempt_id": "821443996dd8", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:57.678651Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13268.967709154822, "hops": {"1": 6896.277834079228, "2": 6372.689875075594}, "receiver_prefill_ms": 226.64520796388388, "ttft_ms": 12.175749987363815, "decode_ms": 12.064957991242409}, "total_wall_ms": 13520.53808409255, "ttft_ms": 12.175749987363815, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6862 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b6b3ac448590ef7597cbad0e", "attempt_id": "98cb0c7a8ad5", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:57.946886Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13268.967709154822, "hops": {"1": 6896.277834079228, "2": 6372.689875075594}, "receiver_prefill_ms": 226.30995803046972, "ttft_ms": 12.314041960053146, "decode_ms": 12.070958036929369}, "total_wall_ms": 13520.389126148075, "ttft_ms": 12.314041960053146, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6863 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0d345796a81846aaa98c201c", "attempt_id": "46761864a207", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:58.215165Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 596, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13268.967709154822, "hops": {"1": 6896.277834079228, "2": 6372.689875075594}, "receiver_prefill_ms": 226.8997090868652, "ttft_ms": 12.095415964722633, "decode_ms": 11.946999933570623}, "total_wall_ms": 13520.565334125422, "ttft_ms": 12.095415964722633, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | |
| 6864 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4bdf6b31732546e18ddc60f3", "attempt_id": "cd86d3586881", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:58.482109Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 610, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13268.967709154822, "hops": {"1": 6896.277834079228, "2": 6372.689875075594}, "receiver_prefill_ms": 229.23491708934307, "ttft_ms": 12.094041099771857, "decode_ms": 83.74658308457583}, "total_wall_ms": 13594.683792092837, "ttft_ms": 12.094041099771857, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8010205", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "6d1ceb36132f38bd77e8f46c23ea21dd9bcff78bc80bd8a9eaf2d7f2f3bacf46"} | |
| 6865 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "2856af02e43ff323d8c69a7b", "attempt_id": "74113a5e69fa", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:58.824450Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13268.967709154822, "hops": {"1": 6896.277834079228, "2": 6372.689875075594}, "receiver_prefill_ms": 227.23045805469155, "ttft_ms": 11.929041938856244, "decode_ms": 83.53291696403176}, "total_wall_ms": 13592.285459162667, "ttft_ms": 11.929041938856244, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6056150", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "f016f8b5fc26708e6c1ff75ff8e98659082c41a168f273819ac48b88feea8d3f"} | |
| 6866 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "541ad99c626c3a41b2c3175d", "attempt_id": "5659a2252616", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:59.163426Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 613, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13268.967709154822, "hops": {"1": 6896.277834079228, "2": 6372.689875075594}, "receiver_prefill_ms": 229.40008400473744, "ttft_ms": 11.954874964430928, "decode_ms": 83.58804101590067}, "total_wall_ms": 13594.433375168592, "ttft_ms": 11.954874964430928, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lunlith-13", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "c45f000afe6d865c8167954eebdff761141225817d4f5b26c962cd50cd75d391"} | |
| 6867 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b6f096479c1c3767ecfd79af", "attempt_id": "bedd18d26377", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:59.504837Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13268.967709154822, "hops": {"1": 6896.277834079228, "2": 6372.689875075594}, "receiver_prefill_ms": 226.7585409572348, "ttft_ms": 11.888833018019795, "decode_ms": 107.57604101672769}, "total_wall_ms": 13615.696668159217, "ttft_ms": 11.888833018019795, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "23,450165", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "a929e5c5097069e202c39470de0d2861ac8d456564e72788db30daadb9f19129"} | |
| 6868 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "03a625a270456957c9a5260d", "attempt_id": "d2753c6723dc", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:59.866982Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13268.967709154822, "hops": {"1": 6896.277834079228, "2": 6372.689875075594}, "receiver_prefill_ms": 227.17066702898592, "ttft_ms": 12.123832944780588, "decode_ms": 11.935041984543204}, "total_wall_ms": 13520.759376115166, "ttft_ms": 12.123832944780588, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6869 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "82286b4876452534535fc3f7", "attempt_id": "fc32f95bc122", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:00.134157Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13268.967709154822, "hops": {"1": 6896.277834079228, "2": 6372.689875075594}, "receiver_prefill_ms": 227.18558309134096, "ttft_ms": 11.929249973036349, "decode_ms": 11.930458946153522}, "total_wall_ms": 13520.495167118497, "ttft_ms": 11.929249973036349, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6870 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ecb5609d72e2010bf8a46dd6", "attempt_id": "b3f114190f70", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:00.401203Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 608, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13268.967709154822, "hops": {"1": 6896.277834079228, "2": 6372.689875075594}, "receiver_prefill_ms": 227.34008298721164, "ttft_ms": 11.943458928726614, "decode_ms": 12.19241600483656}, "total_wall_ms": 13520.941001246683, "ttft_ms": 11.943458928726614, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6871 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ff1006e28b6f6c0c9566fe34", "attempt_id": "a51fca6b3e37", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:13.407941Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 594, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26005.745126167312, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415}, "receiver_prefill_ms": 226.7156249145046, "ttft_ms": 12.033959035761654, "decode_ms": 11.925957980565727}, "total_wall_ms": 26257.028710097075, "ttft_ms": 12.033959035761654, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6872 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0f34eb76b4cc9238155f6bda", "attempt_id": "53b937192b1b", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:13.675623Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 601, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26005.745126167312, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415}, "receiver_prefill_ms": 226.34779091458768, "ttft_ms": 12.206749990582466, "decode_ms": 142.62641698587686}, "total_wall_ms": 26387.52383517567, "ttft_ms": 12.206749990582466, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 12}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 247-S, Baie-Comeau", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "77b7da1d43e7d8815e9e9159ebbd735045bc7f668260ba30b93674f70622b8ec"} | |
| 6873 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d865c8871bae28443662716e", "attempt_id": "e05e91e03c9d", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:14.073210Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26005.745126167312, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415}, "receiver_prefill_ms": 226.63799999281764, "ttft_ms": 11.91820902749896, "decode_ms": 82.98595796804875}, "total_wall_ms": 26327.778584207408, "ttft_ms": 11.91820902749896, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "15.0054", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "d13adba73068c847c850237059e0202fc5b91ccacf2e792e9ce5e3b90556501a"} | |
| 6874 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "6816ded36c88edd66b898984", "attempt_id": "19c5a78e1d25", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:14.410499Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26005.745126167312, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415}, "receiver_prefill_ms": 226.96537501178682, "ttft_ms": 12.162000057287514, "decode_ms": 106.8377080373466}, "total_wall_ms": 26352.300918195397, "ttft_ms": 12.162000057287514, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Priyamvada Sørlie", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "c5f554196ed23dd71ad995ec89f7142099d524dbb6534cc10d94a0c89d13e792"} | |
| 6875 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c301dd766530faf62455a168", "attempt_id": "81b901526295", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:14.772878Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26005.745126167312, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415}, "receiver_prefill_ms": 227.0164160290733, "ttft_ms": 12.081584078259766, "decode_ms": 11.892499984242022}, "total_wall_ms": 26257.335210219026, "ttft_ms": 12.081584078259766, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6876 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "515b9ba7e270b411ea70bebc", "attempt_id": "22dcd59bf4de", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:15.040142Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26005.745126167312, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415}, "receiver_prefill_ms": 227.2122090216726, "ttft_ms": 11.936416034586728, "decode_ms": 12.089541996829212}, "total_wall_ms": 26257.46879214421, "ttft_ms": 11.936416034586728, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6877 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d1511681c18cdabba4457282", "attempt_id": "034bd2cbc782", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:15.307282Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26005.745126167312, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415}, "receiver_prefill_ms": 226.56787501182407, "ttft_ms": 12.073084013536572, "decode_ms": 11.860958067700267}, "total_wall_ms": 26256.818293244578, "ttft_ms": 12.073084013536572, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6878 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "2ec7fa37799fc68a66dde9e2", "attempt_id": "a4a75d106f20", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:15.573209Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 596, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26005.745126167312, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415}, "receiver_prefill_ms": 226.69395804405212, "ttft_ms": 11.937333038076758, "decode_ms": 11.821958003565669}, "total_wall_ms": 26256.68870913796, "ttft_ms": 11.937333038076758, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | |
| 6879 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d27ec1b890aacecdb5689e44", "attempt_id": "9e1a0fbc23ca", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:15.839519Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 610, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26005.745126167312, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415}, "receiver_prefill_ms": 228.81687502376735, "ttft_ms": 12.114583048969507, "decode_ms": 83.16391706466675}, "total_wall_ms": 26330.437876167707, "ttft_ms": 12.114583048969507, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8010205", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "6d1ceb36132f38bd77e8f46c23ea21dd9bcff78bc80bd8a9eaf2d7f2f3bacf46"} | |
| 6880 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9a44dbfe50a76668bb7d8098", "attempt_id": "25b5e424bc5e", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:16.179154Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26005.745126167312, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415}, "receiver_prefill_ms": 227.1562909008935, "ttft_ms": 11.805207934230566, "decode_ms": 82.96349993906915}, "total_wall_ms": 26328.26362620108, "ttft_ms": 11.805207934230566, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6056150", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "f016f8b5fc26708e6c1ff75ff8e98659082c41a168f273819ac48b88feea8d3f"} | |
| 6881 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ce4a8ce342fe2b4d9d75cef4", "attempt_id": "3145a04bf5b4", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:16.517038Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 613, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26005.745126167312, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415}, "receiver_prefill_ms": 229.53029198106378, "ttft_ms": 11.93220796994865, "decode_ms": 83.03158299531788}, "total_wall_ms": 26330.745167215355, "ttft_ms": 11.93220796994865, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lunlith-13", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "c45f000afe6d865c8167954eebdff761141225817d4f5b26c962cd50cd75d391"} | |
| 6882 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "cf43bac325be2e3c6cdbe538", "attempt_id": "02116ce0e197", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:16.857399Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26005.745126167312, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415}, "receiver_prefill_ms": 227.23541699815542, "ttft_ms": 11.96366606745869, "decode_ms": 106.80866707116365}, "total_wall_ms": 26352.34383516945, "ttft_ms": 11.96366606745869, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "23,450165", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "a929e5c5097069e202c39470de0d2861ac8d456564e72788db30daadb9f19129"} | |
| 6883 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "cb444dc416a2807482ddba59", "attempt_id": "4bd944d4aad0", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:17.219825Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26005.745126167312, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415}, "receiver_prefill_ms": 227.01216698624194, "ttft_ms": 12.129625072702765, "decode_ms": 11.959999916143715}, "total_wall_ms": 26257.44529312942, "ttft_ms": 12.129625072702765, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6884 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9cd4e7c12cea665f50ab676a", "attempt_id": "6946650fb94e", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:17.487458Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26005.745126167312, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415}, "receiver_prefill_ms": 227.3828339530155, "ttft_ms": 12.002791976556182, "decode_ms": 11.87199994456023}, "total_wall_ms": 26257.582126068883, "ttft_ms": 12.002791976556182, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6885 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "91adf0fd87f698d5fc4ccc26", "attempt_id": "9ce3f9c45474", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:17.754665Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 608, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26005.745126167312, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415}, "receiver_prefill_ms": 227.2061250405386, "ttft_ms": 12.478624936193228, "decode_ms": 12.182833044789732}, "total_wall_ms": 26258.310334174894, "ttft_ms": 12.478624936193228, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6886 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "37df68d8055d79fbfd23563b", "attempt_id": "ca9e93fa7e21", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:43.427164Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 594, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51405.68041824736, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415, "5": 6348.349208012223, "6": 6350.234291981906, "7": 6348.7960420316085, "8": 6352.555750054307}, "receiver_prefill_ms": 227.07891697064042, "ttft_ms": 11.851249961182475, "decode_ms": 11.946334037929773}, "total_wall_ms": 51657.05141820945, "ttft_ms": 11.851249961182475, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6887 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "3fbb5dbcefb601f59b61329c", "attempt_id": "d116a2b33bc3", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:43.694527Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 601, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51405.68041824736, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415, "5": 6348.349208012223, "6": 6350.234291981906, "7": 6348.7960420316085, "8": 6352.555750054307}, "receiver_prefill_ms": 227.05824999138713, "ttft_ms": 11.875666910782456, "decode_ms": 142.63566699810326}, "total_wall_ms": 51787.73366822861, "ttft_ms": 11.875666910782456, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 12}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 247-S, Baie-Comeau", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "77b7da1d43e7d8815e9e9159ebbd735045bc7f668260ba30b93674f70622b8ec"} | |
| 6888 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5cee5fdde1034c1da3597c7c", "attempt_id": "b6cadff16730", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:44.091872Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51405.68041824736, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415, "5": 6348.349208012223, "6": 6350.234291981906, "7": 6348.7960420316085, "8": 6352.555750054307}, "receiver_prefill_ms": 227.16091701295227, "ttft_ms": 11.90966705325991, "decode_ms": 83.14320794306695}, "total_wall_ms": 51728.349834214896, "ttft_ms": 11.90966705325991, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "15.0054", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "d13adba73068c847c850237059e0202fc5b91ccacf2e792e9ce5e3b90556501a"} | |
| 6889 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7258afe9605849d00393b6f2", "attempt_id": "29885195cd24", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:44.429461Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51405.68041824736, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415, "5": 6348.349208012223, "6": 6350.234291981906, "7": 6348.7960420316085, "8": 6352.555750054307}, "receiver_prefill_ms": 227.08812507335097, "ttft_ms": 11.908416985534132, "decode_ms": 106.7351249512285}, "total_wall_ms": 51751.89341825899, "ttft_ms": 11.908416985534132, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Priyamvada Sørlie", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "c5f554196ed23dd71ad995ec89f7142099d524dbb6534cc10d94a0c89d13e792"} | |
| 6890 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "6ed83324d3a81cb598bdfe59", "attempt_id": "17cdac03bc1e", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:44.790918Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51405.68041824736, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415, "5": 6348.349208012223, "6": 6350.234291981906, "7": 6348.7960420316085, "8": 6352.555750054307}, "receiver_prefill_ms": 227.51779097598046, "ttft_ms": 11.86512503772974, "decode_ms": 11.907125008292496}, "total_wall_ms": 51657.44196018204, "ttft_ms": 11.86512503772974, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6891 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "be09b3aa2cf0ce21e167c50f", "attempt_id": "5eda559b81c8", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:45.057736Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51405.68041824736, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415, "5": 6348.349208012223, "6": 6350.234291981906, "7": 6348.7960420316085, "8": 6352.555750054307}, "receiver_prefill_ms": 227.63350000604987, "ttft_ms": 11.872583068907261, "decode_ms": 11.936583905480802}, "total_wall_ms": 51657.599751255475, "ttft_ms": 11.872583068907261, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6892 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "1ff9d580e18b146759c5708a", "attempt_id": "808c256cbac4", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:45.324773Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51405.68041824736, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415, "5": 6348.349208012223, "6": 6350.234291981906, "7": 6348.7960420316085, "8": 6352.555750054307}, "receiver_prefill_ms": 226.95679205935448, "ttft_ms": 11.836083023808897, "decode_ms": 11.92099996842444}, "total_wall_ms": 51656.8319182843, "ttft_ms": 11.836083023808897, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6893 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5f0340a743fad487b3bf3c62", "attempt_id": "2423134f87ea", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:45.590986Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 596, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51405.68041824736, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415, "5": 6348.349208012223, "6": 6350.234291981906, "7": 6348.7960420316085, "8": 6352.555750054307}, "receiver_prefill_ms": 227.29758301284164, "ttft_ms": 11.906791012734175, "decode_ms": 11.86133292503655}, "total_wall_ms": 51657.20420924481, "ttft_ms": 11.906791012734175, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | |
| 6894 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "1cb6280d20f6891b6924da71", "attempt_id": "ab8085c940ca", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:45.857087Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 610, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51405.68041824736, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415, "5": 6348.349208012223, "6": 6350.234291981906, "7": 6348.7960420316085, "8": 6352.555750054307}, "receiver_prefill_ms": 229.32608297560364, "ttft_ms": 11.926500010304153, "decode_ms": 82.94041699264199}, "total_wall_ms": 51730.34229315817, "ttft_ms": 11.926500010304153, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8010205", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "6d1ceb36132f38bd77e8f46c23ea21dd9bcff78bc80bd8a9eaf2d7f2f3bacf46"} | |
| 6895 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b27be43fe49ed2b2f7c41115", "attempt_id": "dfd418fb5e0a", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:46.196742Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51405.68041824736, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415, "5": 6348.349208012223, "6": 6350.234291981906, "7": 6348.7960420316085, "8": 6352.555750054307}, "receiver_prefill_ms": 227.38179203588516, "ttft_ms": 12.031542020849884, "decode_ms": 82.88679202087224}, "total_wall_ms": 51728.450918220915, "ttft_ms": 12.031542020849884, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6056150", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "f016f8b5fc26708e6c1ff75ff8e98659082c41a168f273819ac48b88feea8d3f"} | |
| 6896 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "57775a8b8c086ba5469d6edc", "attempt_id": "a7a503e3100a", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:46.534662Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 613, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51405.68041824736, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415, "5": 6348.349208012223, "6": 6350.234291981906, "7": 6348.7960420316085, "8": 6352.555750054307}, "receiver_prefill_ms": 229.35337503440678, "ttft_ms": 11.958708055317402, "decode_ms": 83.04466598201543}, "total_wall_ms": 51730.515543255024, "ttft_ms": 11.958708055317402, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lunlith-13", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "c45f000afe6d865c8167954eebdff761141225817d4f5b26c962cd50cd75d391"} | |
| 6897 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "07f9e2f958596f66b857e98e", "attempt_id": "0f41a48e3b3f", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:46.874530Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51405.68041824736, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415, "5": 6348.349208012223, "6": 6350.234291981906, "7": 6348.7960420316085, "8": 6352.555750054307}, "receiver_prefill_ms": 226.87454207334667, "ttft_ms": 11.904707993380725, "decode_ms": 119.04387490358204}, "total_wall_ms": 51763.96646024659, "ttft_ms": 11.904707993380725, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "23,450,777", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "3894c3c39e5c76c297dfb1859a5e1724e2454039e072357510c841bc907d01a5"} | |
| 6898 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "edc488dc9231b9ba0fcc4ff0", "attempt_id": "ddc061e2b281", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:47.247702Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51405.68041824736, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415, "5": 6348.349208012223, "6": 6350.234291981906, "7": 6348.7960420316085, "8": 6352.555750054307}, "receiver_prefill_ms": 227.00095898471773, "ttft_ms": 11.933500063605607, "decode_ms": 11.876834090799093}, "total_wall_ms": 51656.951210228726, "ttft_ms": 11.933500063605607, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6899 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7fb0d639e291adf520c80ab8", "attempt_id": "a2f2e9a8fbfe", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:47.514050Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51405.68041824736, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415, "5": 6348.349208012223, "6": 6350.234291981906, "7": 6348.7960420316085, "8": 6352.555750054307}, "receiver_prefill_ms": 227.1774170221761, "ttft_ms": 11.896083015017211, "decode_ms": 11.803666944615543}, "total_wall_ms": 51657.00679330621, "ttft_ms": 11.896083015017211, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6900 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "78503e57a1b0783db6da36c3", "attempt_id": "2dd8e8d64a86", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:47.780586Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 608, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51405.68041824736, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415, "5": 6348.349208012223, "6": 6350.234291981906, "7": 6348.7960420316085, "8": 6352.555750054307}, "receiver_prefill_ms": 226.98229097295552, "ttft_ms": 11.855292017571628, "decode_ms": 11.927249957807362}, "total_wall_ms": 51656.907084281556, "ttft_ms": 11.855292017571628, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6901 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "dc91bf3256611aa501924736", "attempt_id": "f8fd82f647e2", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:54.929608Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 411, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6880.990542005748, "hops": {"1": 6880.990542005748}, "receiver_prefill_ms": 161.8083749199286, "ttft_ms": 11.755542014725506, "decode_ms": 11.817999999038875}, "total_wall_ms": 7066.811042022891, "ttft_ms": 11.755542014725506, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6902 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "6cbe80d42f9714060a2991d0", "attempt_id": "8c6a5a6dbe22", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:55.130994Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 418, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6880.990542005748, "hops": {"1": 6880.990542005748}, "receiver_prefill_ms": 163.06329204235226, "ttft_ms": 11.834666947834194, "decode_ms": 11.84266700875014}, "total_wall_ms": 7068.1651250924915, "ttft_ms": 11.834666947834194, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6903 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b0ad1d43e019fa53ed4f0173", "attempt_id": "478a77e6a2c0", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:55.333579Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 417, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6880.990542005748, "hops": {"1": 6880.990542005748}, "receiver_prefill_ms": 162.7220829250291, "ttft_ms": 11.770875076763332, "decode_ms": 11.774334008805454}, "total_wall_ms": 7067.642375943251, "ttft_ms": 11.770875076763332, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6904 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "788a17db9e1537b34287249a", "attempt_id": "6631850234e7", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:55.535125Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 412, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6880.990542005748, "hops": {"1": 6880.990542005748}, "receiver_prefill_ms": 162.14337502606213, "ttft_ms": 11.827750015072525, "decode_ms": 105.74670799542218}, "total_wall_ms": 7161.081625963561, "ttft_ms": 11.827750015072525, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Priyamvada Sørlie", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "c5f554196ed23dd71ad995ec89f7142099d524dbb6534cc10d94a0c89d13e792"} | |
| 6905 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9460e4679fa38b776c8c592f", "attempt_id": "5022e9728bd7", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:55.830167Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 423, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6880.990542005748, "hops": {"1": 6880.990542005748}, "receiver_prefill_ms": 163.51045900955796, "ttft_ms": 11.79112505633384, "decode_ms": 11.737541994079947}, "total_wall_ms": 7068.429584032856, "ttft_ms": 11.79112505633384, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6906 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d7b5715c41d1321977f4f986", "attempt_id": "624a3ba78665", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:56.032452Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 420, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6880.990542005748, "hops": {"1": 6880.990542005748}, "receiver_prefill_ms": 163.4532919852063, "ttft_ms": 11.797582963481545, "decode_ms": 117.62612499296665}, "total_wall_ms": 7174.235957907513, "ttft_ms": 11.797582963481545, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "WT-26M-9227", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "ef2302e0ab6f5a6951b11463fea177ba766b9d438afcaf6e6101ebfa3ba38aba"} | |
| 6907 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "52c9e7d825e2534692398267", "attempt_id": "173908bff61e", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:56.340583Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 412, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6880.990542005748, "hops": {"1": 6880.990542005748}, "receiver_prefill_ms": 161.7492079967633, "ttft_ms": 11.77383295726031, "decode_ms": 11.793666984885931}, "total_wall_ms": 7066.660376032814, "ttft_ms": 11.77383295726031, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6908 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "15721e70ebc62d40ce737d3c", "attempt_id": "0b9700866239", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:56.541097Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 413, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6880.990542005748, "hops": {"1": 6880.990542005748}, "receiver_prefill_ms": 162.26837504655123, "ttft_ms": 11.79854094516486, "decode_ms": 11.771459016017616}, "total_wall_ms": 7067.187792039476, "ttft_ms": 11.79854094516486, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6909 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5b731c948e203da928543b78", "attempt_id": "ac3bf59ea017", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:56.742292Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 427, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6880.990542005748, "hops": {"1": 6880.990542005748}, "receiver_prefill_ms": 164.2026249319315, "ttft_ms": 11.838082922622561, "decode_ms": 105.69224995560944}, "total_wall_ms": 7163.160209078342, "ttft_ms": 11.838082922622561, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,914,937", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "c56851abfdbf8851226a1e71c4911c616a691c490a883eb754e61bac551d004c"} | |
| 6910 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9f91a40ae69006ed1e5cd02d", "attempt_id": "f6502e223df8", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:57.039446Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 420, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6880.990542005748, "hops": {"1": 6880.990542005748}, "receiver_prefill_ms": 162.7134169684723, "ttft_ms": 11.790916905738413, "decode_ms": 94.00495805311948}, "total_wall_ms": 7149.857000098564, "ttft_ms": 11.790916905738413, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "15828866", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "c9d49be6f876880a6dfe30589ff0b746c048ebaf1842118a883f5503a349a8b6"} | |
| 6911 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4cf09811dbc2279993f1a833", "attempt_id": "5b7de7e763f7", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:57.323554Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 430, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6880.990542005748, "hops": {"1": 6880.990542005748}, "receiver_prefill_ms": 164.0333749819547, "ttft_ms": 11.753374943509698, "decode_ms": 11.779749998822808}, "total_wall_ms": 7068.9538340084255, "ttft_ms": 11.753374943509698, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6912 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "59a500566bdd55db455ad8b4", "attempt_id": "794842ffcd57", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:57.526547Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 423, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6880.990542005748, "hops": {"1": 6880.990542005748}, "receiver_prefill_ms": 163.1590829929337, "ttft_ms": 11.918083066120744, "decode_ms": 82.08591700531542}, "total_wall_ms": 7138.619584031403, "ttft_ms": 11.918083066120744, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6914937", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "534d40ded32f784c68307dd2386faed2a27bf39dcc27321ee6985e42ccd285e5"} | |
| 6913 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "48670f301a79e0bb5d3c71b0", "attempt_id": "e89bed80944f", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:57.799468Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 420, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6880.990542005748, "hops": {"1": 6880.990542005748}, "receiver_prefill_ms": 163.70604105759412, "ttft_ms": 11.711874976754189, "decode_ms": 11.718790978193283}, "total_wall_ms": 7068.602624931373, "ttft_ms": 11.711874976754189, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6914 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4646412da99cbc2f36971c9c", "attempt_id": "ef266b3c327b", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:58.002612Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 423, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6880.990542005748, "hops": {"1": 6880.990542005748}, "receiver_prefill_ms": 163.35641697514802, "ttft_ms": 12.127833091653883, "decode_ms": 11.905333027243614}, "total_wall_ms": 7068.938417010941, "ttft_ms": 12.127833091653883, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6915 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9d26bae2abb3869b62d84b4d", "attempt_id": "5a2f5b547565", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:58.205623Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 425, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6880.990542005748, "hops": {"1": 6880.990542005748}, "receiver_prefill_ms": 162.71916695404798, "ttft_ms": 12.210833956487477, "decode_ms": 11.97233295533806}, "total_wall_ms": 7068.44333303161, "ttft_ms": 12.210833956487477, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6916 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a215fb56bdd5d9dcc24ee100", "attempt_id": "6872ee6a37c9", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:02.286724Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 376, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10756.447292049415, "hops": {"1": 6880.990542005748, "2": 3875.456750043668}, "receiver_prefill_ms": 143.5628749895841, "ttft_ms": 11.809916002675891, "decode_ms": 11.738666100427508}, "total_wall_ms": 10923.97341702599, "ttft_ms": 11.809916002675891, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6917 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "80f81157a4dd9708955d1999", "attempt_id": "35b9f0e90c25", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:02.470318Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 383, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10756.447292049415, "hops": {"1": 6880.990542005748, "2": 3875.456750043668}, "receiver_prefill_ms": 144.05679190531373, "ttft_ms": 11.773000005632639, "decode_ms": 11.773083009757102}, "total_wall_ms": 10924.424584023654, "ttft_ms": 11.773000005632639, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6918 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "3c193555e08b06c0c29574bd", "attempt_id": "84b5076b1f98", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:02.653790Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 382, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10756.447292049415, "hops": {"1": 6880.990542005748, "2": 3875.456750043668}, "receiver_prefill_ms": 143.37716600857675, "ttft_ms": 11.903790989890695, "decode_ms": 11.75787509419024}, "total_wall_ms": 10923.935167025775, "ttft_ms": 11.903790989890695, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6919 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a6c018aceca5a88492bcdb91", "attempt_id": "e42cad0c552b", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:02.837343Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 377, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10756.447292049415, "hops": {"1": 6880.990542005748, "2": 3875.456750043668}, "receiver_prefill_ms": 143.55033403262496, "ttft_ms": 11.759332963265479, "decode_ms": 105.43054109439254}, "total_wall_ms": 11017.573041957803, "ttft_ms": 11.759332963265479, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Priyamvada Sørlie", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "c5f554196ed23dd71ad995ec89f7142099d524dbb6534cc10d94a0c89d13e792"} | |
| 6920 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "583deff437bb60efb1b6c8f8", "attempt_id": "63ee471a94da", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:03.114265Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 388, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10756.447292049415, "hops": {"1": 6880.990542005748, "2": 3875.456750043668}, "receiver_prefill_ms": 161.0157919349149, "ttft_ms": 11.84691593516618, "decode_ms": 11.685207951813936}, "total_wall_ms": 10941.439876100048, "ttft_ms": 11.84691593516618, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6921 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a8f600170f94579ec9585d34", "attempt_id": "6b9c20cf7d3f", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:03.314364Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 385, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10756.447292049415, "hops": {"1": 6880.990542005748, "2": 3875.456750043668}, "receiver_prefill_ms": 142.33524992596358, "ttft_ms": 11.749166995286942, "decode_ms": 116.95554200559855}, "total_wall_ms": 11027.872417122126, "ttft_ms": 11.749166995286942, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "WT-26M-9227", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "ef2302e0ab6f5a6951b11463fea177ba766b9d438afcaf6e6101ebfa3ba38aba"} | |
| 6922 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "bc8cecc338f4d774bf3db62a", "attempt_id": "850bc39cf5ff", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:03.601080Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 377, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10756.447292049415, "hops": {"1": 6880.990542005748, "2": 3875.456750043668}, "receiver_prefill_ms": 143.05870793759823, "ttft_ms": 12.021500035189092, "decode_ms": 11.887499946169555}, "total_wall_ms": 10923.935708007775, "ttft_ms": 12.021500035189092, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6923 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "cdef368123aba3a0bbe72e54", "attempt_id": "364d8e70244c", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:03.783684Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 378, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10756.447292049415, "hops": {"1": 6880.990542005748, "2": 3875.456750043668}, "receiver_prefill_ms": 142.8997089387849, "ttft_ms": 12.004165910184383, "decode_ms": 11.800624895840883}, "total_wall_ms": 10923.662667046301, "ttft_ms": 12.004165910184383, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6924 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "6481b95b4e7bb581fbe16fe3", "attempt_id": "4236d1c6f117", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:03.968321Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 392, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10756.447292049415, "hops": {"1": 6880.990542005748, "2": 3875.456750043668}, "receiver_prefill_ms": 161.11570899374783, "ttft_ms": 12.195707997307181, "decode_ms": 106.42774996813387}, "total_wall_ms": 11036.710750078782, "ttft_ms": 12.195707997307181, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,914,937", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "c56851abfdbf8851226a1e71c4911c616a691c490a883eb754e61bac551d004c"} | |
| 6925 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "1544335c4a8e6a5ff2c7427e", "attempt_id": "27cfaf6f0bd2", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:04.266219Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 385, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10756.447292049415, "hops": {"1": 6880.990542005748, "2": 3875.456750043668}, "receiver_prefill_ms": 142.22429203800857, "ttft_ms": 12.08758307620883, "decode_ms": 82.41825003642589}, "total_wall_ms": 10993.69737599045, "ttft_ms": 12.08758307620883, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6914937", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "534d40ded32f784c68307dd2386faed2a27bf39dcc27321ee6985e42ccd285e5"} | |
| 6926 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "8edca167e09f3375bc616adf", "attempt_id": "bc297b7098fc", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:04.520972Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 395, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10756.447292049415, "hops": {"1": 6880.990542005748, "2": 3875.456750043668}, "receiver_prefill_ms": 161.3340419717133, "ttft_ms": 12.025582953356206, "decode_ms": 11.966958991251886}, "total_wall_ms": 10942.332791979425, "ttft_ms": 12.025582953356206, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6927 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "3dee557e0c4e200d2b200a6f", "attempt_id": "d4b530b0131e", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:04.724024Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 388, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10756.447292049415, "hops": {"1": 6880.990542005748, "2": 3875.456750043668}, "receiver_prefill_ms": 160.82124994136393, "ttft_ms": 12.035874999128282, "decode_ms": 82.46141695417464}, "total_wall_ms": 11012.295959051698, "ttft_ms": 12.035874999128282, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6914937", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "534d40ded32f784c68307dd2386faed2a27bf39dcc27321ee6985e42ccd285e5"} | |
| 6928 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a1ba19e6806d21bca12e1e30", "attempt_id": "db44ca22e817", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:04.997627Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 385, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10756.447292049415, "hops": {"1": 6880.990542005748, "2": 3875.456750043668}, "receiver_prefill_ms": 142.9430419811979, "ttft_ms": 12.168082990683615, "decode_ms": 11.824416927993298}, "total_wall_ms": 10923.923125024885, "ttft_ms": 12.168082990683615, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6929 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "49c0f71b6f88463fac3f55ca", "attempt_id": "90543c38e07d", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:05.181995Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 388, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10756.447292049415, "hops": {"1": 6880.990542005748, "2": 3875.456750043668}, "receiver_prefill_ms": 160.85291700437665, "ttft_ms": 12.146541033871472, "decode_ms": 11.815583100542426}, "total_wall_ms": 10941.807334078476, "ttft_ms": 12.146541033871472, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6930 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9dbf30fd230eb6add33b7d79", "attempt_id": "08bdc60456e6", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:05.385180Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 390, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10756.447292049415, "hops": {"1": 6880.990542005748, "2": 3875.456750043668}, "receiver_prefill_ms": 161.5862079197541, "ttft_ms": 11.996874934993684, "decode_ms": 11.793666053563356}, "total_wall_ms": 10942.224792088382, "ttft_ms": 11.996874934993684, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6931 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4f5d4177a9dc907602e5718c", "attempt_id": "9c75de4c2aba", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:13.261493Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 376, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18427.254083915614, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443}, "receiver_prefill_ms": 143.47737503703684, "ttft_ms": 11.812917073257267, "decode_ms": 11.73145801294595}, "total_wall_ms": 18594.766833935864, "ttft_ms": 11.812917073257267, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6932 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ef0d4761efbfeb625f4e83a0", "attempt_id": "800fcb539538", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:13.446274Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 383, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18427.254083915614, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443}, "receiver_prefill_ms": 142.933415947482, "ttft_ms": 11.707625002600253, "decode_ms": 11.721999966539443}, "total_wall_ms": 18593.97570893634, "ttft_ms": 11.707625002600253, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6933 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "acd7c806044d2865c211698c", "attempt_id": "09d0aa57434a", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:13.628620Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 382, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18427.254083915614, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443}, "receiver_prefill_ms": 143.11829104553908, "ttft_ms": 11.913125053979456, "decode_ms": 11.759917018935084}, "total_wall_ms": 18594.487750902772, "ttft_ms": 11.913125053979456, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6934 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "26e86c5173d8d85f6653ab36", "attempt_id": "889ee085ddd1", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:13.810524Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 377, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18427.254083915614, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443}, "receiver_prefill_ms": 142.85570802167058, "ttft_ms": 11.718833004124463, "decode_ms": 105.01845797989517}, "total_wall_ms": 18687.208874849603, "ttft_ms": 11.718833004124463, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Priyamvada Sørlie", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "c5f554196ed23dd71ad995ec89f7142099d524dbb6534cc10d94a0c89d13e792"} | |
| 6935 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7ffaa203ef1d4b65f1d36afd", "attempt_id": "2ee3b872449e", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:14.085957Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 388, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18427.254083915614, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443}, "receiver_prefill_ms": 160.48441699240357, "ttft_ms": 11.946541955694556, "decode_ms": 12.141457991674542}, "total_wall_ms": 18612.320083891973, "ttft_ms": 11.946541955694556, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6936 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ad4e51d3cdda20f19eaa8b88", "attempt_id": "c91a46c19aa2", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:14.287565Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 385, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18427.254083915614, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443}, "receiver_prefill_ms": 142.1923750312999, "ttft_ms": 11.8681670865044, "decode_ms": 116.82800005655736}, "total_wall_ms": 18698.578042909503, "ttft_ms": 11.8681670865044, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "WT-26M-9227", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "ef2302e0ab6f5a6951b11463fea177ba766b9d438afcaf6e6101ebfa3ba38aba"} | |
| 6937 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c668cf3ab0edfcf4abfa601b", "attempt_id": "8d70f5c596d9", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:14.574961Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 377, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18427.254083915614, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443}, "receiver_prefill_ms": 142.60345802176744, "ttft_ms": 11.67291693855077, "decode_ms": 11.709416983649135}, "total_wall_ms": 18593.607750954106, "ttft_ms": 11.67291693855077, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6938 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0b51667ccdaeeb0ae4660d84", "attempt_id": "8eb52c29d750", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:14.756334Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 378, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18427.254083915614, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443}, "receiver_prefill_ms": 143.4065829962492, "ttft_ms": 11.7488750256598, "decode_ms": 11.724249925464392}, "total_wall_ms": 18594.483333989047, "ttft_ms": 11.7488750256598, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6939 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f4776219be502d00b1023137", "attempt_id": "5897f745b2d8", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:14.938340Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 392, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18427.254083915614, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443}, "receiver_prefill_ms": 161.03537497110665, "ttft_ms": 11.804500012658536, "decode_ms": 105.1398329436779}, "total_wall_ms": 18705.592874903232, "ttft_ms": 11.804500012658536, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,914,937", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "c56851abfdbf8851226a1e71c4911c616a691c490a883eb754e61bac551d004c"} | |
| 6940 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "1b6ef64ee6a56ca1233d7517", "attempt_id": "02efce2f7fe0", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:15.231234Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 385, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18427.254083915614, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443}, "receiver_prefill_ms": 142.64912507496774, "ttft_ms": 11.904458049684763, "decode_ms": 81.76762494258583}, "total_wall_ms": 18663.90858392697, "ttft_ms": 11.904458049684763, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6914937", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "534d40ded32f784c68307dd2386faed2a27bf39dcc27321ee6985e42ccd285e5"} | |
| 6941 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "196de3234c02bae78e1c224e", "attempt_id": "90583394cd53", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:15.482626Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 395, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18427.254083915614, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443}, "receiver_prefill_ms": 161.09754191711545, "ttft_ms": 11.719250003807247, "decode_ms": 11.691750027239323}, "total_wall_ms": 18612.112749833614, "ttft_ms": 11.719250003807247, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6942 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ae88c3e3f1a5578f7a126f8f", "attempt_id": "11cfa484a26b", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:15.682528Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 388, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18427.254083915614, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443}, "receiver_prefill_ms": 160.5674580205232, "ttft_ms": 11.716125067323446, "decode_ms": 81.88541699200869}, "total_wall_ms": 18681.780041893944, "ttft_ms": 11.716125067323446, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6914937", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "534d40ded32f784c68307dd2386faed2a27bf39dcc27321ee6985e42ccd285e5"} | |
| 6943 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ddd746d82af591115750f48f", "attempt_id": "e072aa26f2ad", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:15.952026Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 385, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18427.254083915614, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443}, "receiver_prefill_ms": 142.90795801207423, "ttft_ms": 11.818624916486442, "decode_ms": 11.799416039139032}, "total_wall_ms": 18594.124916940928, "ttft_ms": 11.818624916486442, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6944 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ce8bd9c159c29e14f8bf882d", "attempt_id": "e1ccebf41b6f", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:16.133793Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 388, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18427.254083915614, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443}, "receiver_prefill_ms": 161.0071249306202, "ttft_ms": 11.830665986053646, "decode_ms": 11.767374933697283}, "total_wall_ms": 18612.18333384022, "ttft_ms": 11.830665986053646, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6945 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "fc70f0d4f80b35e40c9b8113", "attempt_id": "77a828a66882", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:16.333405Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 390, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18427.254083915614, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443}, "receiver_prefill_ms": 161.34524997323751, "ttft_ms": 11.964292032644153, "decode_ms": 11.853417032398283}, "total_wall_ms": 18612.765374942683, "ttft_ms": 11.964292032644153, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6946 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b173341cbe379c0d0a7b28b3", "attempt_id": "d975d197e761", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:31.882605Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 376, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 33771.53900091071, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443, "5": 3843.770332983695, "6": 3833.0124999629334, "7": 3827.791125047952, "8": 3839.710959000513}, "receiver_prefill_ms": 143.2176660746336, "ttft_ms": 11.783457943238318, "decode_ms": 11.821625055745244}, "total_wall_ms": 33938.74595896341, "ttft_ms": 11.783457943238318, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "5": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "6": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "7": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "8": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6947 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "44220c9c7d7054b6eaf60f0c", "attempt_id": "940c762f4e53", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:32.065894Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 383, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 33771.53900091071, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443, "5": 3843.770332983695, "6": 3833.0124999629334, "7": 3827.791125047952, "8": 3839.710959000513}, "receiver_prefill_ms": 143.8692919909954, "ttft_ms": 11.777416919358075, "decode_ms": 11.827833019196987}, "total_wall_ms": 33939.367875806056, "ttft_ms": 11.777416919358075, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "5": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "6": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "7": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "8": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6948 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "86f81738fcaa1956a8116c38", "attempt_id": "e3b7dddcba8e", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:32.249212Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 382, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 33771.53900091071, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443, "5": 3843.770332983695, "6": 3833.0124999629334, "7": 3827.791125047952, "8": 3839.710959000513}, "receiver_prefill_ms": 143.66883295588195, "ttft_ms": 11.724208015948534, "decode_ms": 12.064500013366342}, "total_wall_ms": 33939.35116683133, "ttft_ms": 11.724208015948534, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "5": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "6": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "7": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "8": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6949 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a8f9525849fb21de402671dc", "attempt_id": "c8d0a59299ba", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:32.432388Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 377, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 33771.53900091071, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443, "5": 3843.770332983695, "6": 3833.0124999629334, "7": 3827.791125047952, "8": 3839.710959000513}, "receiver_prefill_ms": 143.6260410118848, "ttft_ms": 11.769667034968734, "decode_ms": 106.04074993170798}, "total_wall_ms": 34033.34854298737, "ttft_ms": 11.769667034968734, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Priyamvada Sørlie", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "5": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "6": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "7": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "8": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "c5f554196ed23dd71ad995ec89f7142099d524dbb6534cc10d94a0c89d13e792"} | |
| 6950 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "beae63f4a02dac2ef15d56ca", "attempt_id": "10b189f7899b", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:32.709415Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 388, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 33771.53900091071, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443, "5": 3843.770332983695, "6": 3833.0124999629334, "7": 3827.791125047952, "8": 3839.710959000513}, "receiver_prefill_ms": 160.79454205464572, "ttft_ms": 11.829916038550436, "decode_ms": 11.93750009406358}, "total_wall_ms": 33956.46762591787, "ttft_ms": 11.829916038550436, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "5": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "6": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "7": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "8": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6951 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "dd92271a33962db624b25f6b", "attempt_id": "1484da0a2689", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:32.909683Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 385, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 33771.53900091071, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443, "5": 3843.770332983695, "6": 3833.0124999629334, "7": 3827.791125047952, "8": 3839.710959000513}, "receiver_prefill_ms": 142.5096249440685, "ttft_ms": 11.806208989582956, "decode_ms": 118.01516695413738}, "total_wall_ms": 34044.2333339015, "ttft_ms": 11.806208989582956, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "WT-26M-9227", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "5": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "6": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "7": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "8": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "ef2302e0ab6f5a6951b11463fea177ba766b9d438afcaf6e6101ebfa3ba38aba"} | |
| 6952 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "6ce8546e294d327883c78944", "attempt_id": "f1521c6475b2", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:33.197715Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 377, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 33771.53900091071, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443, "5": 3843.770332983695, "6": 3833.0124999629334, "7": 3827.791125047952, "8": 3839.710959000513}, "receiver_prefill_ms": 143.50408292375505, "ttft_ms": 11.811125092208385, "decode_ms": 11.785084032453597}, "total_wall_ms": 33938.9966679737, "ttft_ms": 11.811125092208385, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "5": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "6": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "7": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "8": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6953 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "14e2316bae62e3150e5da7ed", "attempt_id": "f22028da1af3", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:33.380636Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 378, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 33771.53900091071, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443, "5": 3843.770332983695, "6": 3833.0124999629334, "7": 3827.791125047952, "8": 3839.710959000513}, "receiver_prefill_ms": 142.95812498312443, "ttft_ms": 11.813041986897588, "decode_ms": 11.816457961685956}, "total_wall_ms": 33938.47612594254, "ttft_ms": 11.813041986897588, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "5": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "6": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "7": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "8": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6954 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "190ff5864d9c0a9fa6431bc6", "attempt_id": "af2a960bdb29", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:33.562613Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 392, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 33771.53900091071, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443, "5": 3843.770332983695, "6": 3833.0124999629334, "7": 3827.791125047952, "8": 3839.710959000513}, "receiver_prefill_ms": 161.10620892141014, "ttft_ms": 11.814457946456969, "decode_ms": 105.62295897398144}, "total_wall_ms": 34050.455209915526, "ttft_ms": 11.814457946456969, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,914,937", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "5": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "6": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "7": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "8": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "c56851abfdbf8851226a1e71c4911c616a691c490a883eb754e61bac551d004c"} | |
| 6955 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "78b59f8fc9ce016fc86219b8", "attempt_id": "536c3afe262c", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:33.856274Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 385, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 33771.53900091071, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443, "5": 3843.770332983695, "6": 3833.0124999629334, "7": 3827.791125047952, "8": 3839.710959000513}, "receiver_prefill_ms": 142.65770895872265, "ttft_ms": 11.740584042854607, "decode_ms": 81.82291698176414}, "total_wall_ms": 34008.11458390672, "ttft_ms": 11.740584042854607, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6914937", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "5": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "6": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "7": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "8": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "534d40ded32f784c68307dd2386faed2a27bf39dcc27321ee6985e42ccd285e5"} | |
| 6956 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "8d16664747a264fac994528e", "attempt_id": "6aada17c4c14", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:34.108050Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 395, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 33771.53900091071, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443, "5": 3843.770332983695, "6": 3833.0124999629334, "7": 3827.791125047952, "8": 3839.710959000513}, "receiver_prefill_ms": 160.55770800448954, "ttft_ms": 11.701749986968935, "decode_ms": 11.696540983393788}, "total_wall_ms": 33955.845542950556, "ttft_ms": 11.701749986968935, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "5": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "6": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "7": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "8": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6957 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f66ab10c7154687f9b902c04", "attempt_id": "3f680ff9bd41", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:34.307316Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 388, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 33771.53900091071, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443, "5": 3843.770332983695, "6": 3833.0124999629334, "7": 3827.791125047952, "8": 3839.710959000513}, "receiver_prefill_ms": 160.3999580256641, "ttft_ms": 11.728040990419686, "decode_ms": 81.81229105684906}, "total_wall_ms": 34025.84295999259, "ttft_ms": 11.728040990419686, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6914937", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "5": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "6": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "7": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "8": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "534d40ded32f784c68307dd2386faed2a27bf39dcc27321ee6985e42ccd285e5"} | |
| 6958 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "8d705cddf11cf741f5df60e0", "attempt_id": "d0314846e27e", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:34.576471Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 385, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 33771.53900091071, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443, "5": 3843.770332983695, "6": 3833.0124999629334, "7": 3827.791125047952, "8": 3839.710959000513}, "receiver_prefill_ms": 142.28320808615535, "ttft_ms": 11.696208966895938, "decode_ms": 11.715666973032057}, "total_wall_ms": 33937.57891689893, "ttft_ms": 11.696208966895938, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "5": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "6": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "7": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "8": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6959 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f0d319a0a906287feb1d2ce9", "attempt_id": "f7535372e763", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:34.757606Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 388, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 33771.53900091071, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443, "5": 3843.770332983695, "6": 3833.0124999629334, "7": 3827.791125047952, "8": 3839.710959000513}, "receiver_prefill_ms": 160.82045796792954, "ttft_ms": 11.703249998390675, "decode_ms": 11.678499984554946}, "total_wall_ms": 33956.093625864014, "ttft_ms": 11.703249998390675, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "5": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "6": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "7": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "8": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6960 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5d3eaf196ab4168c641de924", "attempt_id": "553728977050", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:34.957283Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 390, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 33771.53900091071, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443, "5": 3843.770332983695, "6": 3833.0124999629334, "7": 3827.791125047952, "8": 3839.710959000513}, "receiver_prefill_ms": 160.95841699279845, "ttft_ms": 11.682874988764524, "decode_ms": 11.715583968907595}, "total_wall_ms": 33956.26037591137, "ttft_ms": 11.682874988764524, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "5": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "6": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "7": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "8": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6961 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "6e6fd989c552471cceede09d", "attempt_id": "0c3d90351834", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:42.072957Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 594, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6913.723333040252, "hops": {"1": 6913.723333040252}, "receiver_prefill_ms": 225.96166701987386, "ttft_ms": 12.14233401697129, "decode_ms": 12.142083025537431}, "total_wall_ms": 7164.618417038582, "ttft_ms": 12.14233401697129, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6962 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b985e7ee755f590f19dd7ced", "attempt_id": "1f364c6119a6", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:42.340858Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 601, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6913.723333040252, "hops": {"1": 6913.723333040252}, "receiver_prefill_ms": 226.10537498258054, "ttft_ms": 12.183125014416873, "decode_ms": 143.83104199077934}, "total_wall_ms": 7296.495040995069, "ttft_ms": 12.183125014416873, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 12}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 247-S, Baie-Comeau", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "77b7da1d43e7d8815e9e9159ebbd735045bc7f668260ba30b93674f70622b8ec"} | |
| 6963 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "548a8796c91c2ecf2521bbd7", "attempt_id": "5e01c238a318", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:42.740299Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6913.723333040252, "hops": {"1": 6913.723333040252}, "receiver_prefill_ms": 226.22108296491206, "ttft_ms": 12.253916938789189, "decode_ms": 84.06479202676564}, "total_wall_ms": 7236.934624030255, "ttft_ms": 12.253916938789189, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "15.0054", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "d13adba73068c847c850237059e0202fc5b91ccacf2e792e9ce5e3b90556501a"} | |
| 6964 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "39c511551d0929cbd8c30526", "attempt_id": "9aa07bc3c245", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:43.080421Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6913.723333040252, "hops": {"1": 6913.723333040252}, "receiver_prefill_ms": 226.4239169890061, "ttft_ms": 12.130500050261617, "decode_ms": 107.62237501330674}, "total_wall_ms": 7260.570583050139, "ttft_ms": 12.130500050261617, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Priyamvada Sørlie", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "c5f554196ed23dd71ad995ec89f7142099d524dbb6534cc10d94a0c89d13e792"} | |
| 6965 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "6b2b4122f63542287d3f9fba", "attempt_id": "7471bc7cb223", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:43.444163Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6913.723333040252, "hops": {"1": 6913.723333040252}, "receiver_prefill_ms": 226.8315830733627, "ttft_ms": 12.146459077484906, "decode_ms": 11.996458051726222}, "total_wall_ms": 7165.376124088652, "ttft_ms": 12.146459077484906, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6966 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0a1bb68080696d7ada6bcc03", "attempt_id": "15265438a15d", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:43.713002Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6913.723333040252, "hops": {"1": 6913.723333040252}, "receiver_prefill_ms": 226.76500002853572, "ttft_ms": 12.177166994661093, "decode_ms": 11.972832959145308}, "total_wall_ms": 7165.297083090991, "ttft_ms": 12.177166994661093, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6967 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9e4325b1939b80f9c577f774", "attempt_id": "29f482ef35a7", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:43.981236Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6913.723333040252, "hops": {"1": 6913.723333040252}, "receiver_prefill_ms": 226.59629094414413, "ttft_ms": 12.120499974116683, "decode_ms": 11.998625006526709}, "total_wall_ms": 7165.1322490070015, "ttft_ms": 12.120499974116683, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6968 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "327c40a35449264958ac7ec0", "attempt_id": "f6ffd1b7f38b", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:44.249810Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 596, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6913.723333040252, "hops": {"1": 6913.723333040252}, "receiver_prefill_ms": 226.79187497124076, "ttft_ms": 12.165124993771315, "decode_ms": 11.956791044212878}, "total_wall_ms": 7165.306583046913, "ttft_ms": 12.165124993771315, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | |
| 6969 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "62ad7b40251cf5a894e0e5f5", "attempt_id": "f599a6e76ed3", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:44.519082Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 610, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6913.723333040252, "hops": {"1": 6913.723333040252}, "receiver_prefill_ms": 229.277583071962, "ttft_ms": 12.159582925960422, "decode_ms": 84.08250007778406}, "total_wall_ms": 7239.922000095248, "ttft_ms": 12.159582925960422, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8010205", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "6d1ceb36132f38bd77e8f46c23ea21dd9bcff78bc80bd8a9eaf2d7f2f3bacf46"} | |
| 6970 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "757649df8e9bbc3b12bc3ed2", "attempt_id": "e0ea438959ef", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:44.862223Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6913.723333040252, "hops": {"1": 6913.723333040252}, "receiver_prefill_ms": 226.67512495536357, "ttft_ms": 12.085333000868559, "decode_ms": 107.8914999961853}, "total_wall_ms": 7261.088541010395, "ttft_ms": 12.085333000868559, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,056,150", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "8262889a8478c7e0ee965f159d9849a3849b412e276f5b979476e2da5b320249"} | |
| 6971 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "bdcbc28dec2dfaa66c061550", "attempt_id": "72a15ea591a0", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:45.226549Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 613, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6913.723333040252, "hops": {"1": 6913.723333040252}, "receiver_prefill_ms": 228.9500420447439, "ttft_ms": 12.183125014416873, "decode_ms": 83.30258296336979}, "total_wall_ms": 7238.800166058354, "ttft_ms": 12.183125014416873, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lunlith-13", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "c45f000afe6d865c8167954eebdff761141225817d4f5b26c962cd50cd75d391"} | |
| 6972 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b6d5f31a9df67f6e222bc2ae", "attempt_id": "d538ccfd6487", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:45.568474Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6913.723333040252, "hops": {"1": 6913.723333040252}, "receiver_prefill_ms": 226.82812495622784, "ttft_ms": 12.169958092272282, "decode_ms": 118.85733297094703}, "total_wall_ms": 7272.266249055974, "ttft_ms": 12.169958092272282, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "23,450,077", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "2044d7c4afd32892ac22705680e35174db83308c139b02a1494275cc5e24aff3"} | |
| 6973 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b9a6db463aabbfd242e621b6", "attempt_id": "b3d8766da95d", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:45.943582Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6913.723333040252, "hops": {"1": 6913.723333040252}, "receiver_prefill_ms": 226.58933291677386, "ttft_ms": 12.23166601266712, "decode_ms": 12.016292079351842}, "total_wall_ms": 7165.241083013825, "ttft_ms": 12.23166601266712, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6974 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "64a3724f1f53f0a670e85247", "attempt_id": "11b0e4adb5b3", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:46.212212Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6913.723333040252, "hops": {"1": 6913.723333040252}, "receiver_prefill_ms": 227.10920800454915, "ttft_ms": 12.291125021874905, "decode_ms": 12.066417024470866}, "total_wall_ms": 7165.863624075428, "ttft_ms": 12.291125021874905, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6975 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9cef6c4a91ca520c14ebc0fc", "attempt_id": "146173a7e154", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:46.481119Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 608, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6913.723333040252, "hops": {"1": 6913.723333040252}, "receiver_prefill_ms": 226.86308296397328, "ttft_ms": 12.225582962855697, "decode_ms": 12.079791980795562}, "total_wall_ms": 7165.599124040455, "ttft_ms": 12.225582962855697, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6976 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "df0dbdc3889b2a6c345d19f2", "attempt_id": "350b58766205", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:53.289390Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 594, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 854, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13451.244542025961, "hops": {"1": 6913.723333040252, "2": 6537.521208985709}, "receiver_prefill_ms": 226.35254205670208, "ttft_ms": 12.28716701734811, "decode_ms": 12.075082981027663}, "total_wall_ms": 13702.642832999118, "ttft_ms": 12.28716701734811, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6977 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5cf7b6c029ac4818104d7115", "attempt_id": "a6d7f037b37e", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:53.558294Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 601, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 854, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13451.244542025961, "hops": {"1": 6913.723333040252, "2": 6537.521208985709}, "receiver_prefill_ms": 226.64000000804663, "ttft_ms": 12.293500010855496, "decode_ms": 143.57829198706895}, "total_wall_ms": 13834.429916925728, "ttft_ms": 12.293500010855496, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 12}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 247-S, Baie-Comeau", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "77b7da1d43e7d8815e9e9159ebbd735045bc7f668260ba30b93674f70622b8ec"} | |
| 6978 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "08a8bc058ab123854ed02cdc", "attempt_id": "b9ab57669002", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:53.958453Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 854, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13451.244542025961, "hops": {"1": 6913.723333040252, "2": 6537.521208985709}, "receiver_prefill_ms": 226.69533302541822, "ttft_ms": 12.066500028595328, "decode_ms": 83.11524998862296}, "total_wall_ms": 13773.747792001814, "ttft_ms": 12.066500028595328, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "15.0054", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "d13adba73068c847c850237059e0202fc5b91ccacf2e792e9ce5e3b90556501a"} | |
| 6979 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d08ecc1335c91e9ce6267148", "attempt_id": "726638d270fd", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:54.297839Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 854, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13451.244542025961, "hops": {"1": 6913.723333040252, "2": 6537.521208985709}, "receiver_prefill_ms": 226.5240829437971, "ttft_ms": 11.990500031970441, "decode_ms": 106.53254191856831}, "total_wall_ms": 13796.93720897194, "ttft_ms": 11.990500031970441, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Priyamvada Sørlie", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "c5f554196ed23dd71ad995ec89f7142099d524dbb6534cc10d94a0c89d13e792"} | |
| 6980 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b06892989a5155729f89fa32", "attempt_id": "5f63ac8f803c", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:54.660596Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 854, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13451.244542025961, "hops": {"1": 6913.723333040252, "2": 6537.521208985709}, "receiver_prefill_ms": 226.84458293952048, "ttft_ms": 12.060915934853256, "decode_ms": 11.918332893401384}, "total_wall_ms": 13702.739875065163, "ttft_ms": 12.060915934853256, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6981 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "fff346f880d82842e6b4cbea", "attempt_id": "0dc009303f2f", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:54.929017Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 854, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13451.244542025961, "hops": {"1": 6913.723333040252, "2": 6537.521208985709}, "receiver_prefill_ms": 226.62308299914002, "ttft_ms": 12.006666045635939, "decode_ms": 11.951415915973485}, "total_wall_ms": 13702.495709061623, "ttft_ms": 12.006666045635939, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6982 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d62e55029a0ba2cd7e09c719", "attempt_id": "41e92ce0fe55", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:55.197097Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 854, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13451.244542025961, "hops": {"1": 6913.723333040252, "2": 6537.521208985709}, "receiver_prefill_ms": 226.68587497901171, "ttft_ms": 11.990415980108082, "decode_ms": 11.908792075701058}, "total_wall_ms": 13702.452500117943, "ttft_ms": 11.990415980108082, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6983 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "6da39d4d588b902897721ebe", "attempt_id": "7c8707a7d761", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:55.465343Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 596, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 854, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13451.244542025961, "hops": {"1": 6913.723333040252, "2": 6537.521208985709}, "receiver_prefill_ms": 226.7853330122307, "ttft_ms": 11.99666690081358, "decode_ms": 11.910333065316081}, "total_wall_ms": 13702.584250015207, "ttft_ms": 11.99666690081358, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | |
| 6984 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a83ba17574baa40d711dab88", "attempt_id": "0c93cab1f249", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:55.733341Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 610, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 854, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13451.244542025961, "hops": {"1": 6913.723333040252, "2": 6537.521208985709}, "receiver_prefill_ms": 228.2851659692824, "ttft_ms": 12.088999967090786, "decode_ms": 83.26541702263057}, "total_wall_ms": 13775.558584020473, "ttft_ms": 12.088999967090786, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8010205", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "6d1ceb36132f38bd77e8f46c23ea21dd9bcff78bc80bd8a9eaf2d7f2f3bacf46"} | |
| 6985 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "33c1495d050ae225bec74528", "attempt_id": "041173017e3f", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:56.074276Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 854, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13451.244542025961, "hops": {"1": 6913.723333040252, "2": 6537.521208985709}, "receiver_prefill_ms": 226.19133302941918, "ttft_ms": 12.269999948330224, "decode_ms": 82.75495795533061}, "total_wall_ms": 13773.125833948143, "ttft_ms": 12.269999948330224, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6056150", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "f016f8b5fc26708e6c1ff75ff8e98659082c41a168f273819ac48b88feea8d3f"} | |
| 6986 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c7cdc4b421e72469d18bd94f", "attempt_id": "394a75b23025", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:56.412546Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 613, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 854, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13451.244542025961, "hops": {"1": 6913.723333040252, "2": 6537.521208985709}, "receiver_prefill_ms": 228.50770794320852, "ttft_ms": 12.111791060306132, "decode_ms": 82.78241602238268}, "total_wall_ms": 13775.284833973274, "ttft_ms": 12.111791060306132, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lunlith-13", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "c45f000afe6d865c8167954eebdff761141225817d4f5b26c962cd50cd75d391"} | |
| 6987 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d9de66d05b9d383c900d69a5", "attempt_id": "3c26a3fa35cb", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:56.753059Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 854, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13451.244542025961, "hops": {"1": 6913.723333040252, "2": 6537.521208985709}, "receiver_prefill_ms": 226.88262502197176, "ttft_ms": 12.022458016872406, "decode_ms": 106.70112492516637}, "total_wall_ms": 13797.50537511427, "ttft_ms": 12.022458016872406, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "23,450165", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "a929e5c5097069e202c39470de0d2861ac8d456564e72788db30daadb9f19129"} | |
| 6988 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "57b4ec7e0d27a3d7fc0cf8e4", "attempt_id": "02b853b2d02e", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:57.115881Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 854, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13451.244542025961, "hops": {"1": 6913.723333040252, "2": 6537.521208985709}, "receiver_prefill_ms": 226.58875002525747, "ttft_ms": 12.043667025864124, "decode_ms": 11.88120897859335}, "total_wall_ms": 13702.396042062901, "ttft_ms": 12.043667025864124, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6989 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b696778534835305efdbfb84", "attempt_id": "5f15c6112c61", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:57.383842Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 854, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13451.244542025961, "hops": {"1": 6913.723333040252, "2": 6537.521208985709}, "receiver_prefill_ms": 226.85708303470165, "ttft_ms": 12.016250053420663, "decode_ms": 11.925583006814122}, "total_wall_ms": 13702.708334079944, "ttft_ms": 12.016250053420663, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6990 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0a76d42e6f7af180e2ae75f9", "attempt_id": "1ea029929a79", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:57.652009Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 608, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 854, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13451.244542025961, "hops": {"1": 6913.723333040252, "2": 6537.521208985709}, "receiver_prefill_ms": 227.03512501902878, "ttft_ms": 12.07654201425612, "decode_ms": 11.895833071321249}, "total_wall_ms": 13702.917042071931, "ttft_ms": 12.07654201425612, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6991 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d9edfad527989a186700f618", "attempt_id": "9ab32be73dd6", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:10.898438Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 594, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 2562, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26426.132791908458, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466}, "receiver_prefill_ms": 226.20100004132837, "ttft_ms": 12.043249909766018, "decode_ms": 11.869083042256534}, "total_wall_ms": 26676.909374888055, "ttft_ms": 12.043249909766018, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6992 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "89cc6c4231d348a92ae1c360", "attempt_id": "554978bdb979", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:11.166060Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 601, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 2562, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26426.132791908458, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466}, "receiver_prefill_ms": 226.74266702961177, "ttft_ms": 12.103458982892334, "decode_ms": 142.3419580096379}, "total_wall_ms": 26807.97545891255, "ttft_ms": 12.103458982892334, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 12}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 247-S, Baie-Comeau", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "77b7da1d43e7d8815e9e9159ebbd735045bc7f668260ba30b93674f70622b8ec"} | |
| 6993 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7cb051c1c46a0bcf7a727733", "attempt_id": "1aa4eb2e9bf4", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:11.564427Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 2562, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26426.132791908458, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466}, "receiver_prefill_ms": 226.67437500786036, "ttft_ms": 11.96850009728223, "decode_ms": 84.03270808048546}, "total_wall_ms": 26749.359791981988, "ttft_ms": 11.96850009728223, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "15.0054", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "d13adba73068c847c850237059e0202fc5b91ccacf2e792e9ce5e3b90556501a"} | |
| 6994 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "6d9f808101708f68c960c3aa", "attempt_id": "447a22f1d5ab", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:11.904778Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 2562, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26426.132791908458, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466}, "receiver_prefill_ms": 226.30774998106062, "ttft_ms": 12.088541989214718, "decode_ms": 106.47579201031476}, "total_wall_ms": 26771.668457891792, "ttft_ms": 12.088541989214718, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Priyamvada Sørlie", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "c5f554196ed23dd71ad995ec89f7142099d524dbb6534cc10d94a0c89d13e792"} | |
| 6995 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7fbef4fe984176467b6c5f17", "attempt_id": "738c12f40b4c", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:12.266795Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 2562, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26426.132791908458, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466}, "receiver_prefill_ms": 226.79329197853804, "ttft_ms": 12.054541031830013, "decode_ms": 12.051792000420392}, "total_wall_ms": 26677.702624816447, "ttft_ms": 12.054541031830013, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6996 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c7814552da275c5d5d653991", "attempt_id": "a2a35a8c7a74", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:12.534918Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 2562, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26426.132791908458, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466}, "receiver_prefill_ms": 226.98087489698082, "ttft_ms": 12.00774998869747, "decode_ms": 11.901167104952037}, "total_wall_ms": 26677.675499930046, "ttft_ms": 12.00774998869747, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6997 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c2cb6639cb073103e140adc2", "attempt_id": "e8fa8930ff14", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:12.803172Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 2562, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26426.132791908458, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466}, "receiver_prefill_ms": 226.3444580603391, "ttft_ms": 12.020500027574599, "decode_ms": 12.003917014226317}, "total_wall_ms": 26677.15237592347, "ttft_ms": 12.020500027574599, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6998 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a9e5768ece59f38e62e92ef4", "attempt_id": "7e8dd2c472ce", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:13.071146Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 596, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 2562, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26426.132791908458, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466}, "receiver_prefill_ms": 226.0023329872638, "ttft_ms": 12.39254092797637, "decode_ms": 12.073875055648386}, "total_wall_ms": 26677.256583818235, "ttft_ms": 12.39254092797637, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | |
| 6999 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "16081d619c57b203592d22f9", "attempt_id": "63674f47490a", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:13.338648Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 610, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 2562, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26426.132791908458, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466}, "receiver_prefill_ms": 228.54979196563363, "ttft_ms": 12.095917016267776, "decode_ms": 83.30291707534343}, "total_wall_ms": 26750.76162489131, "ttft_ms": 12.095917016267776, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8010205", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "6d1ceb36132f38bd77e8f46c23ea21dd9bcff78bc80bd8a9eaf2d7f2f3bacf46"} | |
| 7000 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "2547156712741e8aac6a6cdf", "attempt_id": "60a208b3fe78", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:13.680175Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 2562, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26426.132791908458, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466}, "receiver_prefill_ms": 226.7534170532599, "ttft_ms": 12.13912502862513, "decode_ms": 83.0200829077512}, "total_wall_ms": 26748.7223749049, "ttft_ms": 12.13912502862513, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6056150", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "f016f8b5fc26708e6c1ff75ff8e98659082c41a168f273819ac48b88feea8d3f"} | |
| 7001 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "cba452fd0ef4d0ad5eee6d55", "attempt_id": "f113f24d7ee1", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:14.019455Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 613, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 2562, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26426.132791908458, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466}, "receiver_prefill_ms": 228.5613330313936, "ttft_ms": 12.18979200348258, "decode_ms": 83.81041698157787}, "total_wall_ms": 26751.38504197821, "ttft_ms": 12.18979200348258, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lunlith-13", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "c45f000afe6d865c8167954eebdff761141225817d4f5b26c962cd50cd75d391"} | |
| 7002 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "77c228a0255d05bd3e716f7a", "attempt_id": "8dca5e3ee55f", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:14.361333Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 2562, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26426.132791908458, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466}, "receiver_prefill_ms": 227.13570797350258, "ttft_ms": 12.029916979372501, "decode_ms": 106.78820800967515}, "total_wall_ms": 26772.779416874982, "ttft_ms": 12.029916979372501, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "23,450165", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "a929e5c5097069e202c39470de0d2861ac8d456564e72788db30daadb9f19129"} | |
| 7003 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "90f071cd7a7512b245abfaf4", "attempt_id": "7fc026131e9f", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:14.725338Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 2562, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26426.132791908458, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466}, "receiver_prefill_ms": 226.80549998767674, "ttft_ms": 11.990292114205658, "decode_ms": 11.960500036366284}, "total_wall_ms": 26677.562749944627, "ttft_ms": 11.990292114205658, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7004 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "be95d7f7e3a3c4a6c32f37c2", "attempt_id": "a19119267cf5", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:14.993732Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 2562, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26426.132791908458, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466}, "receiver_prefill_ms": 227.09733399096876, "ttft_ms": 12.04025000333786, "decode_ms": 12.06674997229129}, "total_wall_ms": 26678.004707908258, "ttft_ms": 12.04025000333786, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7005 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f8c86339a3eb4ef398fe6e60", "attempt_id": "ed9390d91aec", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:15.262618Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 608, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 2562, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26426.132791908458, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466}, "receiver_prefill_ms": 226.85412492137402, "ttft_ms": 12.025041971355677, "decode_ms": 11.947166989557445}, "total_wall_ms": 26677.633916959167, "ttft_ms": 12.025041971355677, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7006 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "1aeb5f54937e2da6c8994065", "attempt_id": "84421481d492", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:41.492059Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 594, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 5978, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 52381.81649975013, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466, "5": 6492.82487493474, "6": 6482.172666001134, "7": 6484.1609169961885, "8": 6496.52524990961}, "receiver_prefill_ms": 226.67104098945856, "ttft_ms": 12.146624969318509, "decode_ms": 11.900875018909574}, "total_wall_ms": 52633.19920876529, "ttft_ms": 12.146624969318509, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7007 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7f9bf270ea8291e919e4a1a5", "attempt_id": "ad561d8fbe8c", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:41.760404Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 601, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 5978, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 52381.81649975013, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466, "5": 6492.82487493474, "6": 6482.172666001134, "7": 6484.1609169961885, "8": 6496.52524990961}, "receiver_prefill_ms": 226.53450001962483, "ttft_ms": 12.05608295276761, "decode_ms": 142.4653750145808}, "total_wall_ms": 52763.53699970059, "ttft_ms": 12.05608295276761, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 12}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 247-S, Baie-Comeau", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "77b7da1d43e7d8815e9e9159ebbd735045bc7f668260ba30b93674f70622b8ec"} | |
| 7008 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "02f5591b35570cef9a088d74", "attempt_id": "515f7bc01037", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:42.158505Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 5978, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 52381.81649975013, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466, "5": 6492.82487493474, "6": 6482.172666001134, "7": 6484.1609169961885, "8": 6496.52524990961}, "receiver_prefill_ms": 226.54391604010016, "ttft_ms": 12.045416980981827, "decode_ms": 83.09945906512439}, "total_wall_ms": 52704.16529173963, "ttft_ms": 12.045416980981827, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "15.0054", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "d13adba73068c847c850237059e0202fc5b91ccacf2e792e9ce5e3b90556501a"} | |
| 7009 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "3e6868a843a0607f2e10955b", "attempt_id": "4feec602560f", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:42.497689Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 5978, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 52381.81649975013, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466, "5": 6492.82487493474, "6": 6482.172666001134, "7": 6484.1609169961885, "8": 6496.52524990961}, "receiver_prefill_ms": 226.34745901450515, "ttft_ms": 12.016375083476305, "decode_ms": 106.95979208685458}, "total_wall_ms": 52727.82749973703, "ttft_ms": 12.016375083476305, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Priyamvada Sørlie", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "c5f554196ed23dd71ad995ec89f7142099d524dbb6534cc10d94a0c89d13e792"} | |
| 7010 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c690b3481e12ef11a37e8bd8", "attempt_id": "2b32d4dc5ecb", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:42.860218Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 5978, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 52381.81649975013, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466, "5": 6492.82487493474, "6": 6482.172666001134, "7": 6484.1609169961885, "8": 6496.52524990961}, "receiver_prefill_ms": 226.99391597416252, "ttft_ms": 12.069249991327524, "decode_ms": 11.948042083531618}, "total_wall_ms": 52633.48758383654, "ttft_ms": 12.069249991327524, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7011 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d10c2a97d11f73b5ef257795", "attempt_id": "382b8e78bdc2", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:43.128682Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 5978, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 52381.81649975013, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466, "5": 6492.82487493474, "6": 6482.172666001134, "7": 6484.1609169961885, "8": 6496.52524990961}, "receiver_prefill_ms": 226.90041607711464, "ttft_ms": 12.111415970139205, "decode_ms": 11.93616702221334}, "total_wall_ms": 52633.430541842245, "ttft_ms": 12.111415970139205, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7012 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e404a7952c0b16c741688be7", "attempt_id": "c8df5a819e29", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:43.397029Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 5978, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 52381.81649975013, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466, "5": 6492.82487493474, "6": 6482.172666001134, "7": 6484.1609169961885, "8": 6496.52524990961}, "receiver_prefill_ms": 226.5007080277428, "ttft_ms": 12.092125019989908, "decode_ms": 11.913749971427023}, "total_wall_ms": 52632.952208747156, "ttft_ms": 12.092125019989908, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7013 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9472f66c3be2613e05c931a8", "attempt_id": "020415f015e0", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:43.664623Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 596, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 5978, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 52381.81649975013, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466, "5": 6492.82487493474, "6": 6482.172666001134, "7": 6484.1609169961885, "8": 6496.52524990961}, "receiver_prefill_ms": 226.55254194978625, "ttft_ms": 12.070374912582338, "decode_ms": 11.949707986786962}, "total_wall_ms": 52633.06937471498, "ttft_ms": 12.070374912582338, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | |
| 7014 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "bbabcc96cd5a72fe8435034a", "attempt_id": "4c3758da9756", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:43.932245Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 610, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 5978, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 52381.81649975013, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466, "5": 6492.82487493474, "6": 6482.172666001134, "7": 6484.1609169961885, "8": 6496.52524990961}, "receiver_prefill_ms": 228.38616697117686, "ttft_ms": 12.151625007390976, "decode_ms": 83.05100002326071}, "total_wall_ms": 52706.074374727905, "ttft_ms": 12.151625007390976, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8010205", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "6d1ceb36132f38bd77e8f46c23ea21dd9bcff78bc80bd8a9eaf2d7f2f3bacf46"} | |
| 7015 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "034ef50cc7813b185f117602", "attempt_id": "90e5c712bda0", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:44.273141Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 5978, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 52381.81649975013, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466, "5": 6492.82487493474, "6": 6482.172666001134, "7": 6484.1609169961885, "8": 6496.52524990961}, "receiver_prefill_ms": 226.02399997413158, "ttft_ms": 12.103083077818155, "decode_ms": 83.07608298491687}, "total_wall_ms": 52703.70483270381, "ttft_ms": 12.103083077818155, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6056150", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "f016f8b5fc26708e6c1ff75ff8e98659082c41a168f273819ac48b88feea8d3f"} | |
| 7016 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0b31d55d64cec5592c667b90", "attempt_id": "92a51ed65cb9", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:44.612304Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 613, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 5978, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 52381.81649975013, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466, "5": 6492.82487493474, "6": 6482.172666001134, "7": 6484.1609169961885, "8": 6496.52524990961}, "receiver_prefill_ms": 228.62429195083678, "ttft_ms": 12.161041027866304, "decode_ms": 83.1940839998424}, "total_wall_ms": 52706.45424979739, "ttft_ms": 12.161041027866304, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lunlith-13", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "c45f000afe6d865c8167954eebdff761141225817d4f5b26c962cd50cd75d391"} | |
| 7017 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ad6f532b3b569a830dcf7911", "attempt_id": "22e400367940", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:44.953782Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 5978, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 52381.81649975013, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466, "5": 6492.82487493474, "6": 6482.172666001134, "7": 6484.1609169961885, "8": 6496.52524990961}, "receiver_prefill_ms": 226.94208403117955, "ttft_ms": 12.143999920226634, "decode_ms": 119.12737495731562}, "total_wall_ms": 52740.74666574597, "ttft_ms": 12.143999920226634, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "23,450,777", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "3894c3c39e5c76c297dfb1859a5e1724e2454039e072357510c841bc907d01a5"} | |
| 7018 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b84b69525c6fcba469e0f1b8", "attempt_id": "6a67ca0887d2", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:45.330111Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 5978, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 52381.81649975013, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466, "5": 6492.82487493474, "6": 6482.172666001134, "7": 6484.1609169961885, "8": 6496.52524990961}, "receiver_prefill_ms": 226.91083303652704, "ttft_ms": 12.10962503682822, "decode_ms": 12.047167052514851}, "total_wall_ms": 52633.554916712455, "ttft_ms": 12.10962503682822, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7019 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "3a6ef133feda9ecc7a8e4e63", "attempt_id": "3e87f416fec5", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:45.599182Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 5978, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 52381.81649975013, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466, "5": 6492.82487493474, "6": 6482.172666001134, "7": 6484.1609169961885, "8": 6496.52524990961}, "receiver_prefill_ms": 226.62904195021838, "ttft_ms": 12.135457945987582, "decode_ms": 11.944000027142465}, "total_wall_ms": 52633.18341667764, "ttft_ms": 12.135457945987582, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7020 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4a334d56e7944cbea659c31e", "attempt_id": "d308556439b7", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:45.867476Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 608, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 5978, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 52381.81649975013, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466, "5": 6492.82487493474, "6": 6482.172666001134, "7": 6484.1609169961885, "8": 6496.52524990961}, "receiver_prefill_ms": 226.80845798458904, "ttft_ms": 12.105750036425889, "decode_ms": 11.993582942523062}, "total_wall_ms": 52633.39083374012, "ttft_ms": 12.105750036425889, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7021 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "dab64d0a547352a5de2a9544", "attempt_id": "13793f9a59d3", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:53.041817Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 411, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6904.5422920025885, "hops": {"1": 6904.5422920025885}, "receiver_prefill_ms": 161.35308309458196, "ttft_ms": 11.968999984674156, "decode_ms": 11.747209005989134}, "total_wall_ms": 7090.143167064525, "ttft_ms": 11.968999984674156, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7022 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "98e33e69fcd96548462d24e8", "attempt_id": "1f644926e934", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:53.244476Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 418, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6904.5422920025885, "hops": {"1": 6904.5422920025885}, "receiver_prefill_ms": 162.33229194767773, "ttft_ms": 12.009500060230494, "decode_ms": 11.792459059506655}, "total_wall_ms": 7091.230208054185, "ttft_ms": 12.009500060230494, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7023 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5fc6b89d06b24bae9d1c3f3a", "attempt_id": "af09ad849a74", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:53.448073Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 417, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6904.5422920025885, "hops": {"1": 6904.5422920025885}, "receiver_prefill_ms": 162.48287493363023, "ttft_ms": 11.940457974560559, "decode_ms": 11.760167079046369}, "total_wall_ms": 7091.2466669688, "ttft_ms": 11.940457974560559, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7024 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "aa2a802f302d6af100ca2314", "attempt_id": "949a3ae10a75", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:53.651464Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 412, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6904.5422920025885, "hops": {"1": 6904.5422920025885}, "receiver_prefill_ms": 161.80162504315376, "ttft_ms": 12.081459048204124, "decode_ms": 106.64941591676325}, "total_wall_ms": 7185.678042005748, "ttft_ms": 12.081459048204124, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Priyamvada Sørlie", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "c5f554196ed23dd71ad995ec89f7142099d524dbb6534cc10d94a0c89d13e792"} | |
| 7025 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "83714a2aa1eb09dc4279d2d0", "attempt_id": "bc10c9c8df81", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:53.949155Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 423, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6904.5422920025885, "hops": {"1": 6904.5422920025885}, "receiver_prefill_ms": 162.68145805224776, "ttft_ms": 11.984875076450408, "decode_ms": 11.788874980993569}, "total_wall_ms": 7091.526416945271, "ttft_ms": 11.984875076450408, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7026 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "6bd30c8f10b52862d5810f45", "attempt_id": "7d2fe4959243", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:54.152836Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 420, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6904.5422920025885, "hops": {"1": 6904.5422920025885}, "receiver_prefill_ms": 162.5219580018893, "ttft_ms": 12.112334021367133, "decode_ms": 118.49020794034004}, "total_wall_ms": 7198.215292068198, "ttft_ms": 12.112334021367133, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "WT-26M-9227", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "ef2302e0ab6f5a6951b11463fea177ba766b9d438afcaf6e6101ebfa3ba38aba"} | |
| 7027 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b7896adeafc7d849a4c3a0af", "attempt_id": "11e6a2cd6e04", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:54.463119Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 412, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6904.5422920025885, "hops": {"1": 6904.5422920025885}, "receiver_prefill_ms": 162.01400000136346, "ttft_ms": 11.932500055991113, "decode_ms": 11.78358297329396}, "total_wall_ms": 7090.810250956565, "ttft_ms": 11.932500055991113, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7028 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "62d9ca57dfb4018dc86169d0", "attempt_id": "72f06d99d7df", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:54.665921Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 413, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6904.5422920025885, "hops": {"1": 6904.5422920025885}, "receiver_prefill_ms": 161.93608404137194, "ttft_ms": 11.971125029958785, "decode_ms": 11.868417030200362}, "total_wall_ms": 7090.858459006995, "ttft_ms": 11.971125029958785, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7029 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "bc3895362ef22e676128c686", "attempt_id": "60e76ad9438f", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:54.868576Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 427, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6904.5422920025885, "hops": {"1": 6904.5422920025885}, "receiver_prefill_ms": 162.84087498206645, "ttft_ms": 11.946416925638914, "decode_ms": 105.67383305169642}, "total_wall_ms": 7185.53083401639, "ttft_ms": 11.946416925638914, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,914,937", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "c56851abfdbf8851226a1e71c4911c616a691c490a883eb754e61bac551d004c"} | |
| 7030 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9e7f5534461c015a02fa459f", "attempt_id": "dfdd77e8b190", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:55.165960Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 420, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6904.5422920025885, "hops": {"1": 6904.5422920025885}, "receiver_prefill_ms": 162.5372909475118, "ttft_ms": 11.957375099882483, "decode_ms": 93.99795904755592}, "total_wall_ms": 7173.577666981146, "ttft_ms": 11.957375099882483, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "15828866", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "c9d49be6f876880a6dfe30589ff0b746c048ebaf1842118a883f5503a349a8b6"} | |
| 7031 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9bea21ab7d2e05318774b882", "attempt_id": "c24f4d354a96", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:55.451771Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 430, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6904.5422920025885, "hops": {"1": 6904.5422920025885}, "receiver_prefill_ms": 162.81020897440612, "ttft_ms": 11.880208039656281, "decode_ms": 11.8079170351848}, "total_wall_ms": 7091.553583042696, "ttft_ms": 11.880208039656281, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7032 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "805673cfffe8889e3fd2bff6", "attempt_id": "424674c91996", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:55.655480Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 423, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6904.5422920025885, "hops": {"1": 6904.5422920025885}, "receiver_prefill_ms": 162.78024995699525, "ttft_ms": 11.979625094681978, "decode_ms": 82.71695801522583}, "total_wall_ms": 7162.57908300031, "ttft_ms": 11.979625094681978, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6914937", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "534d40ded32f784c68307dd2386faed2a27bf39dcc27321ee6985e42ccd285e5"} | |
| 7033 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "69eab1984a9641b97adf6fc1", "attempt_id": "0ef1215be621", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:55.930212Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 420, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6904.5422920025885, "hops": {"1": 6904.5422920025885}, "receiver_prefill_ms": 162.80720895156264, "ttft_ms": 11.959749972447753, "decode_ms": 11.858667014166713}, "total_wall_ms": 7091.693707974628, "ttft_ms": 11.959749972447753, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7034 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b11dc7bbca785c64eba7d265", "attempt_id": "6d626ab87bb7", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:56.133825Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 423, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6904.5422920025885, "hops": {"1": 6904.5422920025885}, "receiver_prefill_ms": 163.12254196964204, "ttft_ms": 12.071083998307586, "decode_ms": 11.853625066578388}, "total_wall_ms": 7092.146209091879, "ttft_ms": 12.071083998307586, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7035 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "03714abd5e5ec0e00f0eb703", "attempt_id": "6f4a2578c06b", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:56.337725Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 425, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6904.5422920025885, "hops": {"1": 6904.5422920025885}, "receiver_prefill_ms": 162.3170409584418, "ttft_ms": 11.97616697754711, "decode_ms": 11.79329096339643}, "total_wall_ms": 7091.1500009242445, "ttft_ms": 11.97616697754711, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7036 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e775fc3bab68ed83ead8cea7", "attempt_id": "0ae83bca10c1", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:00.922722Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 420, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 602, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11284.805292030796, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208}, "receiver_prefill_ms": 162.09245810750872, "ttft_ms": 11.985916993580759, "decode_ms": 12.057916959747672}, "total_wall_ms": 11471.509834052995, "ttft_ms": 11.985916993580759, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7037 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "1696aaf6c268c3e6658bf492", "attempt_id": "127a32e44648", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:01.126583Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 427, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 602, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11284.805292030796, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208}, "receiver_prefill_ms": 162.84387500490993, "ttft_ms": 11.996875051409006, "decode_ms": 11.861791950650513}, "total_wall_ms": 11472.064876114018, "ttft_ms": 11.996875051409006, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7038 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0d07e34dce806c0e6cb7bed6", "attempt_id": "832687ce30a6", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:01.330487Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 426, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 602, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11284.805292030796, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208}, "receiver_prefill_ms": 162.6890420448035, "ttft_ms": 12.013040948659182, "decode_ms": 11.781834065914154}, "total_wall_ms": 11471.826125052758, "ttft_ms": 12.013040948659182, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7039 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d8968a0a4346de1fecc8dcb5", "attempt_id": "fe0b5ef8e6a2", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:01.533918Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 421, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 602, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11284.805292030796, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208}, "receiver_prefill_ms": 162.48783294577152, "ttft_ms": 12.087165960110724, "decode_ms": 106.29158304072917}, "total_wall_ms": 11566.244917106815, "ttft_ms": 12.087165960110724, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Priyamvada Sørlie", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "c5f554196ed23dd71ad995ec89f7142099d524dbb6534cc10d94a0c89d13e792"} | |
| 7040 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d7c55ef06bfb85aedf69d997", "attempt_id": "e1929096b231", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:01.831743Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 432, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 602, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11284.805292030796, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208}, "receiver_prefill_ms": 162.69545897375792, "ttft_ms": 12.013084022328258, "decode_ms": 11.807791073806584}, "total_wall_ms": 11471.873625996523, "ttft_ms": 12.013084022328258, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7041 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "17e55ae417f32d2b1cfa701e", "attempt_id": "fca1fcbc54f1", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:02.035823Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 429, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 602, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11284.805292030796, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208}, "receiver_prefill_ms": 163.11737499199808, "ttft_ms": 11.956166941672564, "decode_ms": 117.67824995331466}, "total_wall_ms": 11578.09308404103, "ttft_ms": 11.956166941672564, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "WT-26M-9227", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "ef2302e0ab6f5a6951b11463fea177ba766b9d438afcaf6e6101ebfa3ba38aba"} | |
| 7042 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ab5af495ee733eb9022b0f44", "attempt_id": "9889aead7b6e", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:02.345805Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 421, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 602, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11284.805292030796, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208}, "receiver_prefill_ms": 162.54537494387478, "ttft_ms": 11.936415918171406, "decode_ms": 11.806041933596134}, "total_wall_ms": 11471.638292074203, "ttft_ms": 11.936415918171406, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7043 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "8dbd1b624ce6756619d5ba71", "attempt_id": "c01f4066c5d1", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:02.548884Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 422, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 602, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11284.805292030796, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208}, "receiver_prefill_ms": 163.00804202910513, "ttft_ms": 11.888957931660116, "decode_ms": 11.774999904446304}, "total_wall_ms": 11472.005667048506, "ttft_ms": 11.888957931660116, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7044 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "3e771d59b7a17f49bb2df650", "attempt_id": "7f3d6a008293", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:02.752438Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 436, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 602, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11284.805292030796, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208}, "receiver_prefill_ms": 163.1523750256747, "ttft_ms": 12.022958020679653, "decode_ms": 106.00737505592406}, "total_wall_ms": 11566.529459087178, "ttft_ms": 12.022958020679653, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,914,937", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "c56851abfdbf8851226a1e71c4911c616a691c490a883eb754e61bac551d004c"} | |
| 7045 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "cdd456e1214b18e16a30fac5", "attempt_id": "5e7a25bfad26", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:03.050493Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 429, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 602, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11284.805292030796, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208}, "receiver_prefill_ms": 163.13912498299032, "ttft_ms": 12.226958060637116, "decode_ms": 94.86566693522036}, "total_wall_ms": 11555.596334044822, "ttft_ms": 12.226958060637116, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "15828866", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "c9d49be6f876880a6dfe30589ff0b746c048ebaf1842118a883f5503a349a8b6"} | |
| 7046 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d5fa1ff6cab1fe04d163a98f", "attempt_id": "e3add4802be9", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:03.338111Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 439, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 602, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11284.805292030796, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208}, "receiver_prefill_ms": 163.31266600172967, "ttft_ms": 11.974875000305474, "decode_ms": 11.80491701234132}, "total_wall_ms": 11472.441207966767, "ttft_ms": 11.974875000305474, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7047 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4886b86ef15b303367702cf0", "attempt_id": "ad0f77ee89ed", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:03.542500Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 432, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 602, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11284.805292030796, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208}, "receiver_prefill_ms": 162.80037490651011, "ttft_ms": 12.014084029942751, "decode_ms": 82.52329204697162}, "total_wall_ms": 11542.69691708032, "ttft_ms": 12.014084029942751, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6914937", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "534d40ded32f784c68307dd2386faed2a27bf39dcc27321ee6985e42ccd285e5"} | |
| 7048 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "8e825058dd772199c9e5477d", "attempt_id": "1bfcc1f9fe83", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:03.816780Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 429, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 602, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11284.805292030796, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208}, "receiver_prefill_ms": 162.76987502351403, "ttft_ms": 11.977499932982028, "decode_ms": 11.774958111345768}, "total_wall_ms": 11471.862250007689, "ttft_ms": 11.977499932982028, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7049 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "de6ad348ea47793b0c2e5cbc", "attempt_id": "7cdfd5890c82", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:04.020291Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 432, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 602, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11284.805292030796, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208}, "receiver_prefill_ms": 162.82299999147654, "ttft_ms": 11.96270901709795, "decode_ms": 11.970332940109074}, "total_wall_ms": 11472.077584010549, "ttft_ms": 11.96270901709795, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7050 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4908d3841e4aa6f2b500f61c", "attempt_id": "8d77966a0093", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:04.223968Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 434, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 602, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11284.805292030796, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208}, "receiver_prefill_ms": 163.1097919307649, "ttft_ms": 11.991541017778218, "decode_ms": 11.808917042799294}, "total_wall_ms": 11472.263500094414, "ttft_ms": 11.991541017778218, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7051 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9c21f8bb1ddde17384c00141", "attempt_id": "fc6bc5a2e662", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:13.176836Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 420, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 1806, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20031.605917145498, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101}, "receiver_prefill_ms": 162.25183405913413, "ttft_ms": 11.997958994470537, "decode_ms": 11.784625006839633}, "total_wall_ms": 20218.177042203024, "ttft_ms": 11.997958994470537, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7052 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "751f48bf49f0ad6f27c2923c", "attempt_id": "0d3c69cf0d1a", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:13.380555Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 427, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 1806, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20031.605917145498, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101}, "receiver_prefill_ms": 162.82395797315985, "ttft_ms": 11.958041926845908, "decode_ms": 11.7972920415923}, "total_wall_ms": 20218.719209195115, "ttft_ms": 11.958041926845908, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7053 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "17756b5049a9ffcad090e3dc", "attempt_id": "2b4b553f47d8", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:13.584240Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 426, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 1806, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20031.605917145498, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101}, "receiver_prefill_ms": 162.5250829383731, "ttft_ms": 11.995665961876512, "decode_ms": 11.941708973608911}, "total_wall_ms": 20218.64683413878, "ttft_ms": 11.995665961876512, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7054 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4fb0caa5a627939e76f5829e", "attempt_id": "c3f6dce83c68", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:13.787718Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 421, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 1806, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20031.605917145498, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101}, "receiver_prefill_ms": 162.5159999821335, "ttft_ms": 11.918375035747886, "decode_ms": 105.98783404566348}, "total_wall_ms": 20312.572292168625, "ttft_ms": 11.918375035747886, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Priyamvada Sørlie", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "c5f554196ed23dd71ad995ec89f7142099d524dbb6534cc10d94a0c89d13e792"} | |
| 7055 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5d8d5b194d65cc28b41287ea", "attempt_id": "49fb1f6cdb05", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:14.084874Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 432, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 1806, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20031.605917145498, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101}, "receiver_prefill_ms": 162.71654202137142, "ttft_ms": 11.935874936170876, "decode_ms": 11.876665987074375}, "total_wall_ms": 20218.70729222428, "ttft_ms": 11.935874936170876, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7056 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e9b2d46179221737e4c2d757", "attempt_id": "143eb2af9a23", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:14.288549Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 429, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 1806, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20031.605917145498, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101}, "receiver_prefill_ms": 163.1305000046268, "ttft_ms": 12.034083949401975, "decode_ms": 117.69745801575482}, "total_wall_ms": 20325.0216251472, "ttft_ms": 12.034083949401975, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "WT-26M-9227", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "ef2302e0ab6f5a6951b11463fea177ba766b9d438afcaf6e6101ebfa3ba38aba"} | |
| 7057 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f5048c85a91773bb28f02db4", "attempt_id": "c73e1c7bda90", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:14.599141Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 421, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 1806, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20031.605917145498, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101}, "receiver_prefill_ms": 162.68974996637553, "ttft_ms": 11.981167015619576, "decode_ms": 11.93391706328839}, "total_wall_ms": 20218.790667131543, "ttft_ms": 11.981167015619576, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7058 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f8a1cf03bd27bfbb71932f5e", "attempt_id": "019f9ca3f15b", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:14.802881Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 422, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 1806, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20031.605917145498, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101}, "receiver_prefill_ms": 162.5451250001788, "ttft_ms": 11.957417009398341, "decode_ms": 11.788124917075038}, "total_wall_ms": 20218.4524590848, "ttft_ms": 11.957417009398341, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7059 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c000a339087b6ea282931afe", "attempt_id": "27a4a925085e", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:15.006497Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 436, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 1806, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20031.605917145498, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101}, "receiver_prefill_ms": 163.19950006436557, "ttft_ms": 12.186832958832383, "decode_ms": 105.9744170634076}, "total_wall_ms": 20313.508458202705, "ttft_ms": 12.186832958832383, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,914,937", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "c56851abfdbf8851226a1e71c4911c616a691c490a883eb754e61bac551d004c"} | |
| 7060 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "2d448014a3e584e8cfd601c7", "attempt_id": "af2cbca5a0f9", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:15.304998Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 429, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 1806, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20031.605917145498, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101}, "receiver_prefill_ms": 162.2902089729905, "ttft_ms": 11.997041990980506, "decode_ms": 94.16520793456584}, "total_wall_ms": 20300.61170924455, "ttft_ms": 11.997041990980506, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "15828865", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b38715dfc60d964ebea3bdcc90d47ca28d803114815818233d093f08214df6ae"} | |
| 7061 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7746e3e1fe1d98dd566c83cc", "attempt_id": "d7eb50fd6d38", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:15.591636Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 439, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 1806, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20031.605917145498, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101}, "receiver_prefill_ms": 163.38491695933044, "ttft_ms": 11.889249901287258, "decode_ms": 11.825541034340858}, "total_wall_ms": 20219.235292170197, "ttft_ms": 11.889249901287258, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7062 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d34ecd59b92be4ad062bcd17", "attempt_id": "ad42a4f2d6bf", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:15.795807Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 432, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 1806, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20031.605917145498, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101}, "receiver_prefill_ms": 163.17116608843207, "ttft_ms": 12.047125026583672, "decode_ms": 82.41575001738966}, "total_wall_ms": 20289.788750116713, "ttft_ms": 12.047125026583672, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6914937", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "534d40ded32f784c68307dd2386faed2a27bf39dcc27321ee6985e42ccd285e5"} | |
| 7063 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0d09153a036bf6cc557aec7b", "attempt_id": "55c108237e98", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:16.071138Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 429, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 1806, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20031.605917145498, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101}, "receiver_prefill_ms": 162.26541600190103, "ttft_ms": 11.967791011556983, "decode_ms": 11.867208988405764}, "total_wall_ms": 20218.269708100706, "ttft_ms": 11.967791011556983, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7064 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e7df7cfd0881c4bd8729c5fa", "attempt_id": "f89a2eb1f0b5", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:16.274252Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 432, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 1806, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20031.605917145498, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101}, "receiver_prefill_ms": 162.85170800983906, "ttft_ms": 11.99487503618002, "decode_ms": 11.803624918684363}, "total_wall_ms": 20218.79883413203, "ttft_ms": 11.99487503618002, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7065 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "71464fbbcc1692cd9e7f4cce", "attempt_id": "6cbe67c15efd", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:16.478275Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 434, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 1806, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20031.605917145498, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101}, "receiver_prefill_ms": 163.19333296269178, "ttft_ms": 11.967458995059133, "decode_ms": 11.754250037483871}, "total_wall_ms": 20219.068792182952, "ttft_ms": 11.967458995059133, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7066 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b4afafb68040b44b9c1fc82c", "attempt_id": "5d6eb1e3f4eb", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:34.206915Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 420, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 4214, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37551.62508401554, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101, "5": 4391.168999951333, "6": 4377.536708954722, "7": 4374.012624961324, "8": 4377.300833002664}, "receiver_prefill_ms": 162.8488750429824, "ttft_ms": 11.996084009297192, "decode_ms": 11.838959064334631}, "total_wall_ms": 37738.89483406674, "ttft_ms": 11.996084009297192, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7067 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d6f948964e92b522b70f6569", "attempt_id": "23ad64ba0e56", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:34.411332Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 427, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 4214, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37551.62508401554, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101, "5": 4391.168999951333, "6": 4377.536708954722, "7": 4374.012624961324, "8": 4377.300833002664}, "receiver_prefill_ms": 162.86229202523828, "ttft_ms": 11.990666971541941, "decode_ms": 11.968291946686804}, "total_wall_ms": 37738.99479303509, "ttft_ms": 11.990666971541941, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7068 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c00aac3fe9fd50be18cae024", "attempt_id": "8a4b5312840e", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:34.615554Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 426, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 4214, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37551.62508401554, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101, "5": 4391.168999951333, "6": 4377.536708954722, "7": 4374.012624961324, "8": 4377.300833002664}, "receiver_prefill_ms": 162.7461250172928, "ttft_ms": 12.085292022675276, "decode_ms": 11.794500052928925}, "total_wall_ms": 37738.796918070875, "ttft_ms": 12.085292022675276, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7069 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ac28b052817fd71b7c34046d", "attempt_id": "6853feec4d2e", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:34.819212Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 421, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 4214, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37551.62508401554, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101, "5": 4391.168999951333, "6": 4377.536708954722, "7": 4374.012624961324, "8": 4377.300833002664}, "receiver_prefill_ms": 162.26975002791733, "ttft_ms": 11.933750007301569, "decode_ms": 105.8265829924494}, "total_wall_ms": 37832.18812500127, "ttft_ms": 11.933750007301569, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Priyamvada Sørlie", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "c5f554196ed23dd71ad995ec89f7142099d524dbb6534cc10d94a0c89d13e792"} | |
| 7070 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9cdbccae53bba2d9a4d44a84", "attempt_id": "f203b1c63fa8", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:35.116097Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 432, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 4214, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37551.62508401554, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101, "5": 4391.168999951333, "6": 4377.536708954722, "7": 4374.012624961324, "8": 4377.300833002664}, "receiver_prefill_ms": 162.9758341005072, "ttft_ms": 12.005583965219557, "decode_ms": 11.819457984529436}, "total_wall_ms": 37738.981500966474, "ttft_ms": 12.005583965219557, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7071 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "acad1d07d8826bbc007c28f0", "attempt_id": "d5cd60bdd5c8", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:35.320506Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 429, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 4214, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37551.62508401554, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101, "5": 4391.168999951333, "6": 4377.536708954722, "7": 4374.012624961324, "8": 4377.300833002664}, "receiver_prefill_ms": 162.78112505096942, "ttft_ms": 11.994667001999915, "decode_ms": 117.7488750545308}, "total_wall_ms": 37844.68225098681, "ttft_ms": 11.994667001999915, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "WT-26M-9227", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "ef2302e0ab6f5a6951b11463fea177ba766b9d438afcaf6e6101ebfa3ba38aba"} | |
| 7072 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7a240f56fa53b0d50b39a871", "attempt_id": "52484533d07c", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:35.630298Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 421, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 4214, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37551.62508401554, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101, "5": 4391.168999951333, "6": 4377.536708954722, "7": 4374.012624961324, "8": 4377.300833002664}, "receiver_prefill_ms": 162.44033304974437, "ttft_ms": 11.959042050875723, "decode_ms": 11.80325006134808}, "total_wall_ms": 37738.37541707326, "ttft_ms": 11.959042050875723, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7073 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "74c23190343c10ac03dbf635", "attempt_id": "df1d707151eb", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:35.833524Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 422, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 4214, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37551.62508401554, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101, "5": 4391.168999951333, "6": 4377.536708954722, "7": 4374.012624961324, "8": 4377.300833002664}, "receiver_prefill_ms": 162.72825002670288, "ttft_ms": 12.043875060044229, "decode_ms": 11.784875066950917}, "total_wall_ms": 37738.72566805221, "ttft_ms": 12.043875060044229, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7074 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "6ee2d494446dd486ca015d17", "attempt_id": "856c43d4ce76", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:36.036757Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 436, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 4214, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37551.62508401554, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101, "5": 4391.168999951333, "6": 4377.536708954722, "7": 4374.012624961324, "8": 4377.300833002664}, "receiver_prefill_ms": 162.82924998085946, "ttft_ms": 12.080707936547697, "decode_ms": 106.78008291870356}, "total_wall_ms": 37833.86616699863, "ttft_ms": 12.080707936547697, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,914,937", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "c56851abfdbf8851226a1e71c4911c616a691c490a883eb754e61bac551d004c"} | |
| 7075 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "fb8baac8f08eb7f253855b90", "attempt_id": "7e86b02eb9a8", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:36.335315Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 429, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 4214, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37551.62508401554, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101, "5": 4391.168999951333, "6": 4377.536708954722, "7": 4374.012624961324, "8": 4377.300833002664}, "receiver_prefill_ms": 163.19829202257097, "ttft_ms": 12.103290995582938, "decode_ms": 94.25379196181893}, "total_wall_ms": 37821.74595899414, "ttft_ms": 12.103290995582938, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "15828869", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "c37a6a24f6b43a5a4c626354b69a44fd62c2a91de72daee7f63e18e6519e339c"} | |
| 7076 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f983dd5cc660adb3a0944dc3", "attempt_id": "3428f9ab3c0d", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:36.621764Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 439, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 4214, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37551.62508401554, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101, "5": 4391.168999951333, "6": 4377.536708954722, "7": 4374.012624961324, "8": 4377.300833002664}, "receiver_prefill_ms": 163.37683296296746, "ttft_ms": 12.100375024601817, "decode_ms": 11.785792070440948}, "total_wall_ms": 37739.43362594582, "ttft_ms": 12.100375024601817, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7077 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5a3b938433b7325380210ba5", "attempt_id": "d16eade7a533", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:36.826294Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 432, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 4214, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37551.62508401554, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101, "5": 4391.168999951333, "6": 4377.536708954722, "7": 4374.012624961324, "8": 4377.300833002664}, "receiver_prefill_ms": 163.18254102952778, "ttft_ms": 11.924582999199629, "decode_ms": 82.65087497420609}, "total_wall_ms": 37809.9230841035, "ttft_ms": 11.924582999199629, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6914937", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "534d40ded32f784c68307dd2386faed2a27bf39dcc27321ee6985e42ccd285e5"} | |
| 7078 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ae97db2ca3bf2b857c0c4853", "attempt_id": "855320fc4edc", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:37.100907Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 429, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 4214, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37551.62508401554, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101, "5": 4391.168999951333, "6": 4377.536708954722, "7": 4374.012624961324, "8": 4377.300833002664}, "receiver_prefill_ms": 163.13762497156858, "ttft_ms": 12.296458939090371, "decode_ms": 12.01220799703151}, "total_wall_ms": 37739.60337601602, "ttft_ms": 12.296458939090371, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7079 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e5f61921fb6e86702125797a", "attempt_id": "7806cd14f4fb", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:37.305026Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 432, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 4214, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37551.62508401554, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101, "5": 4391.168999951333, "6": 4377.536708954722, "7": 4374.012624961324, "8": 4377.300833002664}, "receiver_prefill_ms": 162.32495789881796, "ttft_ms": 11.958708055317402, "decode_ms": 11.77216600626707}, "total_wall_ms": 37738.21370897349, "ttft_ms": 11.958708055317402, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7080 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "2164eaf55adec160350afcea", "attempt_id": "4028e3ae5bf4", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:37.508467Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 434, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 4214, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37551.62508401554, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101, "5": 4391.168999951333, "6": 4377.536708954722, "7": 4374.012624961324, "8": 4377.300833002664}, "receiver_prefill_ms": 163.11120800673962, "ttft_ms": 12.010792037472129, "decode_ms": 11.776332976296544}, "total_wall_ms": 37739.052542019635, "ttft_ms": 12.010792037472129, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7081 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ecf378f18f83e91a4a2bb009", "attempt_id": "a840f58ffae3", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:44.586850Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 594, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6872.302875039168, "hops": {"1": 6872.302875039168}, "receiver_prefill_ms": 226.39816696755588, "ttft_ms": 12.008749996311963, "decode_ms": 11.808292008936405}, "total_wall_ms": 7123.195458087139, "ttft_ms": 12.008749996311963, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7082 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "3717a5487ca301c1b90e712a", "attempt_id": "18e238d8b598", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:44.854300Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 601, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6872.302875039168, "hops": {"1": 6872.302875039168}, "receiver_prefill_ms": 226.32675000932068, "ttft_ms": 12.204624945297837, "decode_ms": 141.75216702278703}, "total_wall_ms": 7253.243750077672, "ttft_ms": 12.204624945297837, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 12}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 247-S, Baie-Comeau", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "77b7da1d43e7d8815e9e9159ebbd735045bc7f668260ba30b93674f70622b8ec"} | |
| 7083 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f39015b7f4b92e8aadb79155", "attempt_id": "5821318a51f3", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:45.251472Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6872.302875039168, "hops": {"1": 6872.302875039168}, "receiver_prefill_ms": 226.2632919009775, "ttft_ms": 12.079749954864383, "decode_ms": 82.49475003685802}, "total_wall_ms": 7193.786250078119, "ttft_ms": 12.079749954864383, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "15.0054", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "d13adba73068c847c850237059e0202fc5b91ccacf2e792e9ce5e3b90556501a"} | |
| 7084 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "89afbd65374758573e3bf235", "attempt_id": "993379ddccbd", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:45.589886Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6872.302875039168, "hops": {"1": 6872.302875039168}, "receiver_prefill_ms": 226.6386670526117, "ttft_ms": 12.205207953229547, "decode_ms": 107.5730420416221}, "total_wall_ms": 7219.407292082906, "ttft_ms": 12.205207953229547, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Priyamvada Sørlie", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "c5f554196ed23dd71ad995ec89f7142099d524dbb6534cc10d94a0c89d13e792"} | |
| 7085 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a6ceb38c7a36d3b76b121ce6", "attempt_id": "558191f219e4", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:45.953968Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6872.302875039168, "hops": {"1": 6872.302875039168}, "receiver_prefill_ms": 226.708208094351, "ttft_ms": 12.044125003740191, "decode_ms": 11.885791085660458}, "total_wall_ms": 7123.605582979508, "ttft_ms": 12.044125003740191, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7086 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d55940ad814ea51f66aa670d", "attempt_id": "a0400bdb8e95", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:46.222757Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6872.302875039168, "hops": {"1": 6872.302875039168}, "receiver_prefill_ms": 227.11304191034287, "ttft_ms": 12.050083023495972, "decode_ms": 11.975583038292825}, "total_wall_ms": 7124.084834009409, "ttft_ms": 12.050083023495972, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7087 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5f64637debfcb3abed126c29", "attempt_id": "9d1ee3a7170e", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:46.490727Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6872.302875039168, "hops": {"1": 6872.302875039168}, "receiver_prefill_ms": 226.7370419576764, "ttft_ms": 12.006000033579767, "decode_ms": 11.910791974514723}, "total_wall_ms": 7123.604124994017, "ttft_ms": 12.006000033579767, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7088 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "00dcee01a631ac4074851cfd", "attempt_id": "ed9d5d16718b", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:46.758253Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 596, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6872.302875039168, "hops": {"1": 6872.302875039168}, "receiver_prefill_ms": 226.4244999969378, "ttft_ms": 12.102290987968445, "decode_ms": 11.87124999705702}, "total_wall_ms": 7123.323500039987, "ttft_ms": 12.102290987968445, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | |
| 7089 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "dff5d1c7f0b819f9c7b485ba", "attempt_id": "d5715475cd55", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:47.025362Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 610, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6872.302875039168, "hops": {"1": 6872.302875039168}, "receiver_prefill_ms": 228.43862499576062, "ttft_ms": 11.999665992334485, "decode_ms": 82.97087496612221}, "total_wall_ms": 7196.34866702836, "ttft_ms": 11.999665992334485, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8010205", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "6d1ceb36132f38bd77e8f46c23ea21dd9bcff78bc80bd8a9eaf2d7f2f3bacf46"} | |
| 7090 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4d5374393eb6553718c49068", "attempt_id": "b5aa76e038db", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:47.366144Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6872.302875039168, "hops": {"1": 6872.302875039168}, "receiver_prefill_ms": 227.09895798470825, "ttft_ms": 12.103792047128081, "decode_ms": 106.72749998047948}, "total_wall_ms": 7218.880292028189, "ttft_ms": 12.103792047128081, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,056,150", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "8262889a8478c7e0ee965f159d9849a3849b412e276f5b979476e2da5b320249"} | |
| 7091 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "dda8b0ccc53ee42e5fc7832f", "attempt_id": "891dc21a2a8e", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:47.729631Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 613, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6872.302875039168, "hops": {"1": 6872.302875039168}, "receiver_prefill_ms": 228.44483295921236, "ttft_ms": 12.022083974443376, "decode_ms": 82.89099996909499}, "total_wall_ms": 7196.3205829961225, "ttft_ms": 12.022083974443376, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lunlith-13", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "c45f000afe6d865c8167954eebdff761141225817d4f5b26c962cd50cd75d391"} | |
| 7092 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "59f470b9d69dff39cae28df5", "attempt_id": "d64745a6af00", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:48.070402Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6872.302875039168, "hops": {"1": 6872.302875039168}, "receiver_prefill_ms": 226.62149998359382, "ttft_ms": 12.313459068536758, "decode_ms": 118.08500008191913}, "total_wall_ms": 7229.986250051297, "ttft_ms": 12.313459068536758, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "23,450,077", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "2044d7c4afd32892ac22705680e35174db83308c139b02a1494275cc5e24aff3"} | |
| 7093 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c7c9cca67d997a388d204358", "attempt_id": "d513539d765d", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:48.444654Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6872.302875039168, "hops": {"1": 6872.302875039168}, "receiver_prefill_ms": 226.81825002655387, "ttft_ms": 11.991707957349718, "decode_ms": 11.848459020256996}, "total_wall_ms": 7123.618375044316, "ttft_ms": 11.991707957349718, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7094 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "55e681c17db92b0fcb649758", "attempt_id": "93a9f185f633", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:48.712735Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6872.302875039168, "hops": {"1": 6872.302875039168}, "receiver_prefill_ms": 226.541250012815, "ttft_ms": 12.040166067890823, "decode_ms": 11.896249954588711}, "total_wall_ms": 7123.438459006138, "ttft_ms": 12.040166067890823, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7095 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "3a2c56a8ebbc43adf3d95555", "attempt_id": "3e06879f4692", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:48.980309Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 608, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6872.302875039168, "hops": {"1": 6872.302875039168}, "receiver_prefill_ms": 227.02700004447252, "ttft_ms": 11.992000043392181, "decode_ms": 11.835499899461865}, "total_wall_ms": 7123.790000099689, "ttft_ms": 11.992000043392181, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7096 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "292f2d35ea7fc966ba58c3f3", "attempt_id": "5b0fd0a05039", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:54.292130Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 519, "message_tokens": 416, "message_utf8_bytes": 1063, "cache_tensor_bytes": null, "serialized_payload_bytes": 1063, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11915.002124966122, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545}, "receiver_prefill_ms": 209.1570000629872, "ttft_ms": 11.686292011290789, "decode_ms": 11.701290961354971}, "total_wall_ms": 12148.171665961854, "ttft_ms": 11.686292011290789, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a84a1aff1e9050ab45ed7ed2bd9f5306446a866f8b9ff0cedf4ce4f983883642", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7097 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "429d9dd81e60b3d3340970fe", "attempt_id": "c3fe10eaf7c7", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:54.542884Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 526, "message_tokens": 416, "message_utf8_bytes": 1063, "cache_tensor_bytes": null, "serialized_payload_bytes": 1063, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11915.002124966122, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545}, "receiver_prefill_ms": 209.60116700734943, "ttft_ms": 11.759374989196658, "decode_ms": 114.80199999641627}, "total_wall_ms": 12251.792415976524, "ttft_ms": 11.759374989196658, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 247-S, Baie-Comeau", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a84a1aff1e9050ab45ed7ed2bd9f5306446a866f8b9ff0cedf4ce4f983883642", "output_hash": "77b7da1d43e7d8815e9e9159ebbd735045bc7f668260ba30b93674f70622b8ec"} | |
| 7098 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "3afedd96345ac9c9ea4879fa", "attempt_id": "e8c232196903", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:54.896436Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 525, "message_tokens": 416, "message_utf8_bytes": 1063, "cache_tensor_bytes": null, "serialized_payload_bytes": 1063, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11915.002124966122, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545}, "receiver_prefill_ms": 209.69383302144706, "ttft_ms": 11.725250049494207, "decode_ms": 45.76870799064636}, "total_wall_ms": 12182.807583012618, "ttft_ms": 11.725250049494207, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "15.0054", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a84a1aff1e9050ab45ed7ed2bd9f5306446a866f8b9ff0cedf4ce4f983883642", "output_hash": "d13adba73068c847c850237059e0202fc5b91ccacf2e792e9ce5e3b90556501a"} | |
| 7099 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ec7e80efbd61a7c2cc8f41a2", "attempt_id": "5ae3f837d63c", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:55.180655Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 521, "message_tokens": 416, "message_utf8_bytes": 1063, "cache_tensor_bytes": null, "serialized_payload_bytes": 1063, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11915.002124966122, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545}, "receiver_prefill_ms": 209.19991703704, "ttft_ms": 11.640792014077306, "decode_ms": 103.30366692505777}, "total_wall_ms": 12239.772083004937, "ttft_ms": 11.640792014077306, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Priyamvada Sørlie", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a84a1aff1e9050ab45ed7ed2bd9f5306446a866f8b9ff0cedf4ce4f983883642", "output_hash": "c5f554196ed23dd71ad995ec89f7142099d524dbb6534cc10d94a0c89d13e792"} | |
| 7100 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4bbc2899b863a572a5b9185e", "attempt_id": "02c13bf379fd", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:55.521554Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 532, "message_tokens": 416, "message_utf8_bytes": 1063, "cache_tensor_bytes": null, "serialized_payload_bytes": 1063, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11915.002124966122, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545}, "receiver_prefill_ms": 210.0380000192672, "ttft_ms": 11.629624990746379, "decode_ms": 11.488749994896352}, "total_wall_ms": 12148.786542005837, "ttft_ms": 11.629624990746379, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a84a1aff1e9050ab45ed7ed2bd9f5306446a866f8b9ff0cedf4ce4f983883642", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7101 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ca5a2d032fdbe4fb5cd4d564", "attempt_id": "c422f312da6d", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:55.771576Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 527, "message_tokens": 416, "message_utf8_bytes": 1063, "cache_tensor_bytes": null, "serialized_payload_bytes": 1063, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11915.002124966122, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545}, "receiver_prefill_ms": 209.37150006648153, "ttft_ms": 11.71729201450944, "decode_ms": 11.523833964020014}, "total_wall_ms": 12148.233084008098, "ttft_ms": 11.71729201450944, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a84a1aff1e9050ab45ed7ed2bd9f5306446a866f8b9ff0cedf4ce4f983883642", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7102 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "751968142b8b3167a2b7f5d4", "attempt_id": "bb63684a4bb5", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:56.021535Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 521, "message_tokens": 416, "message_utf8_bytes": 1063, "cache_tensor_bytes": null, "serialized_payload_bytes": 1063, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11915.002124966122, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545}, "receiver_prefill_ms": 209.30079196114093, "ttft_ms": 11.983166914433241, "decode_ms": 22.998959058895707}, "total_wall_ms": 12159.89487490151, "ttft_ms": 11.983166914433241, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a84a1aff1e9050ab45ed7ed2bd9f5306446a866f8b9ff0cedf4ce4f983883642", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | |
| 7103 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d3935d5524047cfa8f9b2bf0", "attempt_id": "f11c6fb95282", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:56.282596Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 521, "message_tokens": 416, "message_utf8_bytes": 1063, "cache_tensor_bytes": null, "serialized_payload_bytes": 1063, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11915.002124966122, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545}, "receiver_prefill_ms": 209.30437499191612, "ttft_ms": 11.904875049367547, "decode_ms": 22.978166001848876}, "total_wall_ms": 12159.794874954969, "ttft_ms": 11.904875049367547, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a84a1aff1e9050ab45ed7ed2bd9f5306446a866f8b9ff0cedf4ce4f983883642", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | |
| 7104 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "72e3acf0e01234d3aeab6cee", "attempt_id": "99801e1fe749", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:56.544602Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 536, "message_tokens": 416, "message_utf8_bytes": 1063, "cache_tensor_bytes": null, "serialized_payload_bytes": 1063, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11915.002124966122, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545}, "receiver_prefill_ms": 209.90879100281745, "ttft_ms": 11.64100004825741, "decode_ms": 57.76754196267575}, "total_wall_ms": 12194.930416997522, "ttft_ms": 11.64100004825741, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8,010,205", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a84a1aff1e9050ab45ed7ed2bd9f5306446a866f8b9ff0cedf4ce4f983883642", "output_hash": "12facbb746e46f5872a48eea64f64dc2cbd9610b1548522078108253d03a7904"} | |
| 7105 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "780c38ae1e7a859fb34e6815", "attempt_id": "1280f2628e32", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:56.840885Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 529, "message_tokens": 416, "message_utf8_bytes": 1063, "cache_tensor_bytes": null, "serialized_payload_bytes": 1063, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11915.002124966122, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545}, "receiver_prefill_ms": 209.10687500145286, "ttft_ms": 11.756792082451284, "decode_ms": 57.42233304772526}, "total_wall_ms": 12193.888499983586, "ttft_ms": 11.756792082451284, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,056,150", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a84a1aff1e9050ab45ed7ed2bd9f5306446a866f8b9ff0cedf4ce4f983883642", "output_hash": "8262889a8478c7e0ee965f159d9849a3849b412e276f5b979476e2da5b320249"} | |
| 7106 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "be639b2a148fb27410da43bb", "attempt_id": "5f0e4c640208", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:57.136256Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 537, "message_tokens": 416, "message_utf8_bytes": 1063, "cache_tensor_bytes": null, "serialized_payload_bytes": 1063, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11915.002124966122, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545}, "receiver_prefill_ms": 210.32570803072304, "ttft_ms": 11.808958020992577, "decode_ms": 11.568875052034855}, "total_wall_ms": 12149.332833010703, "ttft_ms": 11.808958020992577, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a84a1aff1e9050ab45ed7ed2bd9f5306446a866f8b9ff0cedf4ce4f983883642", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7107 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ee4d154591dcac9396307c9e", "attempt_id": "2c4ed2618709", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:57.386562Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 532, "message_tokens": 416, "message_utf8_bytes": 1063, "cache_tensor_bytes": null, "serialized_payload_bytes": 1063, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11915.002124966122, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545}, "receiver_prefill_ms": 210.01262497156858, "ttft_ms": 11.720290989615023, "decode_ms": 298.07845898903906}, "total_wall_ms": 12435.455665923655, "ttft_ms": 11.720290989615023, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 26}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,914,937 + 1,787,610 + 8,278,225 = 16,980,772", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.4}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a84a1aff1e9050ab45ed7ed2bd9f5306446a866f8b9ff0cedf4ce4f983883642", "output_hash": "c5fb5d9b76b7a02439f0acb83233430b95eef4aa96f8df88b9152c3b3e51343c"} | |
| 7108 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "8e0eb7bbee465867fbabf295", "attempt_id": "524a6272f179", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:57.924621Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 528, "message_tokens": 416, "message_utf8_bytes": 1063, "cache_tensor_bytes": null, "serialized_payload_bytes": 1063, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11915.002124966122, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545}, "receiver_prefill_ms": 209.4906660495326, "ttft_ms": 11.656083050183952, "decode_ms": 11.460999958217144}, "total_wall_ms": 12148.191374959424, "ttft_ms": 11.656083050183952, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a84a1aff1e9050ab45ed7ed2bd9f5306446a866f8b9ff0cedf4ce4f983883642", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7109 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "83b00003e3fa4b248f69e837", "attempt_id": "d716a71b2147", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:58.174663Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 532, "message_tokens": 416, "message_utf8_bytes": 1063, "cache_tensor_bytes": null, "serialized_payload_bytes": 1063, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11915.002124966122, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545}, "receiver_prefill_ms": 209.80624994263053, "ttft_ms": 11.868958012200892, "decode_ms": 23.161166929639876}, "total_wall_ms": 12160.468666930683, "ttft_ms": 11.868958012200892, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Unknown.", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a84a1aff1e9050ab45ed7ed2bd9f5306446a866f8b9ff0cedf4ce4f983883642", "output_hash": "9cf9f50925b2a7803c73826a305235d4215dc428721c731072a9f2c0f5d6ae5a"} | |
| 7110 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "db09be4d7a69be2eb46431c3", "attempt_id": "f2e89c99e080", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:58.436190Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 534, "message_tokens": 416, "message_utf8_bytes": 1063, "cache_tensor_bytes": null, "serialized_payload_bytes": 1063, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11915.002124966122, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545}, "receiver_prefill_ms": 209.62866698391736, "ttft_ms": 11.73908298369497, "decode_ms": 11.487790965475142}, "total_wall_ms": 12148.470208980143, "ttft_ms": 11.73908298369497, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a84a1aff1e9050ab45ed7ed2bd9f5306446a866f8b9ff0cedf4ce4f983883642", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7111 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "dfabe703c66f3f8e1bd3d719", "attempt_id": "4861d6afec1b", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:09.758074Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 490, "message_tokens": 387, "message_utf8_bytes": 1023, "cache_tensor_bytes": null, "serialized_payload_bytes": 1023, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22983.29725000076, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409}, "receiver_prefill_ms": 206.24066703021526, "ttft_ms": 11.743957991711795, "decode_ms": 11.539915925823152}, "total_wall_ms": 23213.434666977264, "ttft_ms": 11.743957991711795, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9597ef7dd5408dec598b05726488fa7f8924bdb0755c45a0837fd9d429f51e78", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7112 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e4e2f414adcf3890df45d844", "attempt_id": "79f5b35dc816", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:10.004910Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 497, "message_tokens": 387, "message_utf8_bytes": 1023, "cache_tensor_bytes": null, "serialized_payload_bytes": 1023, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22983.29725000076, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409}, "receiver_prefill_ms": 207.9006660496816, "ttft_ms": 11.733249993994832, "decode_ms": 115.8215410541743}, "total_wall_ms": 23319.396708044223, "ttft_ms": 11.733249993994832, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 247-S, Baie-Comeau", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9597ef7dd5408dec598b05726488fa7f8924bdb0755c45a0837fd9d429f51e78", "output_hash": "77b7da1d43e7d8815e9e9159ebbd735045bc7f668260ba30b93674f70622b8ec"} | |
| 7113 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a13b47f56009315605b80552", "attempt_id": "f8ddb8dd3241", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:10.357057Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 496, "message_tokens": 387, "message_utf8_bytes": 1023, "cache_tensor_bytes": null, "serialized_payload_bytes": 1023, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22983.29725000076, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409}, "receiver_prefill_ms": 205.87050006724894, "ttft_ms": 11.806832975707948, "decode_ms": 46.47175001446158}, "total_wall_ms": 23248.114499961957, "ttft_ms": 11.806832975707948, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "15.0054", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9597ef7dd5408dec598b05726488fa7f8924bdb0755c45a0837fd9d429f51e78", "output_hash": "d13adba73068c847c850237059e0202fc5b91ccacf2e792e9ce5e3b90556501a"} | |
| 7114 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "8626319698b2c2156c13f0a7", "attempt_id": "0baf19023d48", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:10.638756Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 492, "message_tokens": 387, "message_utf8_bytes": 1023, "cache_tensor_bytes": null, "serialized_payload_bytes": 1023, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22983.29725000076, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409}, "receiver_prefill_ms": 206.41062501817942, "ttft_ms": 11.7896250449121, "decode_ms": 104.55258307047188}, "total_wall_ms": 23306.675791041926, "ttft_ms": 11.7896250449121, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Priyamvada Sørlie", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9597ef7dd5408dec598b05726488fa7f8924bdb0755c45a0837fd9d429f51e78", "output_hash": "c5f554196ed23dd71ad995ec89f7142099d524dbb6534cc10d94a0c89d13e792"} | |
| 7115 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a9c34da8bf935186ca88ad1b", "attempt_id": "14b5fe2801a6", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:10.978972Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 503, "message_tokens": 387, "message_utf8_bytes": 1023, "cache_tensor_bytes": null, "serialized_payload_bytes": 1023, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22983.29725000076, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409}, "receiver_prefill_ms": 208.06566695682704, "ttft_ms": 11.687041958793998, "decode_ms": 11.644500074908137}, "total_wall_ms": 23215.29337496031, "ttft_ms": 11.687041958793998, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9597ef7dd5408dec598b05726488fa7f8924bdb0755c45a0837fd9d429f51e78", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7116 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9dafde273e18c4ee3e7069eb", "attempt_id": "50f610781441", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:11.227879Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 498, "message_tokens": 387, "message_utf8_bytes": 1023, "cache_tensor_bytes": null, "serialized_payload_bytes": 1023, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22983.29725000076, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409}, "receiver_prefill_ms": 207.67320797313005, "ttft_ms": 11.876165983267128, "decode_ms": 11.814334080554545}, "total_wall_ms": 23215.294416993856, "ttft_ms": 11.876165983267128, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9597ef7dd5408dec598b05726488fa7f8924bdb0755c45a0837fd9d429f51e78", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7117 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "aaa7a7add60ce5e11a1441e7", "attempt_id": "bba9fd272f81", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:11.476430Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 492, "message_tokens": 387, "message_utf8_bytes": 1023, "cache_tensor_bytes": null, "serialized_payload_bytes": 1023, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22983.29725000076, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409}, "receiver_prefill_ms": 205.95729094929993, "ttft_ms": 11.706916033290327, "decode_ms": 23.29354197718203}, "total_wall_ms": 23224.83874997124, "ttft_ms": 11.706916033290327, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9597ef7dd5408dec598b05726488fa7f8924bdb0755c45a0837fd9d429f51e78", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | |
| 7118 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a7eac567267d564d1e795b39", "attempt_id": "f698f696c65b", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:11.734874Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 492, "message_tokens": 387, "message_utf8_bytes": 1023, "cache_tensor_bytes": null, "serialized_payload_bytes": 1023, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22983.29725000076, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409}, "receiver_prefill_ms": 207.91820797603577, "ttft_ms": 11.799959000200033, "decode_ms": 23.308750009164214}, "total_wall_ms": 23226.958292070776, "ttft_ms": 11.799959000200033, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9597ef7dd5408dec598b05726488fa7f8924bdb0755c45a0837fd9d429f51e78", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | |
| 7119 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "8358207eadeb8126475457b5", "attempt_id": "74feeb97cfa4", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:11.995903Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 507, "message_tokens": 387, "message_utf8_bytes": 1023, "cache_tensor_bytes": null, "serialized_payload_bytes": 1023, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22983.29725000076, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409}, "receiver_prefill_ms": 207.12370902765542, "ttft_ms": 11.836000019684434, "decode_ms": 58.3128749858588}, "total_wall_ms": 23261.240166961215, "ttft_ms": 11.836000019684434, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8,010,205", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9597ef7dd5408dec598b05726488fa7f8924bdb0755c45a0837fd9d429f51e78", "output_hash": "12facbb746e46f5872a48eea64f64dc2cbd9610b1548522078108253d03a7904"} | |
| 7120 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "df29ce9d3ec2ca091c6a5f91", "attempt_id": "338bb16699d3", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:12.291250Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 500, "message_tokens": 387, "message_utf8_bytes": 1023, "cache_tensor_bytes": null, "serialized_payload_bytes": 1023, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22983.29725000076, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409}, "receiver_prefill_ms": 206.97824994567782, "ttft_ms": 11.8665830232203, "decode_ms": 58.1426250282675}, "total_wall_ms": 23260.930624906905, "ttft_ms": 11.8665830232203, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,056,150", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9597ef7dd5408dec598b05726488fa7f8924bdb0755c45a0837fd9d429f51e78", "output_hash": "8262889a8478c7e0ee965f159d9849a3849b412e276f5b979476e2da5b320249"} | |
| 7121 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c5a9c203da8d3c85f53bee8c", "attempt_id": "ddeef272b1c2", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:12.585910Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 508, "message_tokens": 387, "message_utf8_bytes": 1023, "cache_tensor_bytes": null, "serialized_payload_bytes": 1023, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22983.29725000076, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409}, "receiver_prefill_ms": 207.73366698995233, "ttft_ms": 11.777165927924216, "decode_ms": 11.898291064426303}, "total_wall_ms": 23215.30525002163, "ttft_ms": 11.777165927924216, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9597ef7dd5408dec598b05726488fa7f8924bdb0755c45a0837fd9d429f51e78", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7122 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "df206db021827fbaf90b5d73", "attempt_id": "12a67fd78404", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:12.834295Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 503, "message_tokens": 387, "message_utf8_bytes": 1023, "cache_tensor_bytes": null, "serialized_payload_bytes": 1023, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22983.29725000076, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409}, "receiver_prefill_ms": 207.91666698642075, "ttft_ms": 11.728040990419686, "decode_ms": 301.89700005576015}, "total_wall_ms": 23505.46812498942, "ttft_ms": 11.728040990419686, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 26}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,914,937 + 1,787,610 + 8,278,225 = 16,980,772", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.4}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9597ef7dd5408dec598b05726488fa7f8924bdb0755c45a0837fd9d429f51e78", "output_hash": "c5fb5d9b76b7a02439f0acb83233430b95eef4aa96f8df88b9152c3b3e51343c"} | |
| 7123 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a25e6f29980ac10c153c7c60", "attempt_id": "3441fa81c60f", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:13.373097Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 499, "message_tokens": 387, "message_utf8_bytes": 1023, "cache_tensor_bytes": null, "serialized_payload_bytes": 1023, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22983.29725000076, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409}, "receiver_prefill_ms": 207.03924994450063, "ttft_ms": 11.80079102050513, "decode_ms": 11.682207928970456}, "total_wall_ms": 23214.439749950543, "ttft_ms": 11.80079102050513, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9597ef7dd5408dec598b05726488fa7f8924bdb0755c45a0837fd9d429f51e78", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7124 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4ab18cd59050673e42c6dbf5", "attempt_id": "c4501c8859f7", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:13.620762Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 503, "message_tokens": 387, "message_utf8_bytes": 1023, "cache_tensor_bytes": null, "serialized_payload_bytes": 1023, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22983.29725000076, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409}, "receiver_prefill_ms": 209.02758301235735, "ttft_ms": 11.82587502989918, "decode_ms": 11.626291903667152}, "total_wall_ms": 23216.419583070092, "ttft_ms": 11.82587502989918, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9597ef7dd5408dec598b05726488fa7f8924bdb0755c45a0837fd9d429f51e78", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7125 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f865d1300eef0a30fee6d154", "attempt_id": "cdc13db857d0", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:13.870869Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 505, "message_tokens": 387, "message_utf8_bytes": 1023, "cache_tensor_bytes": null, "serialized_payload_bytes": 1023, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22983.29725000076, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409}, "receiver_prefill_ms": 208.67758302483708, "ttft_ms": 11.671332991681993, "decode_ms": 11.490499950014055}, "total_wall_ms": 23215.73445899412, "ttft_ms": 11.671332991681993, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9597ef7dd5408dec598b05726488fa7f8924bdb0755c45a0837fd9d429f51e78", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7126 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5bea7e952ef3124857ebf1e5", "attempt_id": "2bab77b0c2af", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:35.766587Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 490, "message_tokens": 387, "message_utf8_bytes": 1022, "cache_tensor_bytes": null, "serialized_payload_bytes": 1022, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 44624.60495799314, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409, "5": 6335.791665944271, "6": 4672.110749990679, "7": 5924.405542085879, "8": 4708.999749971554}, "receiver_prefill_ms": 205.54070791695267, "ttft_ms": 11.606125044636428, "decode_ms": 11.500791064463556}, "total_wall_ms": 44853.72995806392, "ttft_ms": 11.606125044636428, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "5": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1050}, "6": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1010}, "7": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 992}, "8": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5864c0b88a688a045e4eb1d1985303e81b16f7e80826e759450dac2bb9d2e48", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7127 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "6d04997b4e7393c1c4d422f7", "attempt_id": "0ca8e559b3c2", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:36.012329Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 497, "message_tokens": 387, "message_utf8_bytes": 1022, "cache_tensor_bytes": null, "serialized_payload_bytes": 1022, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 44624.60495799314, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409, "5": 6335.791665944271, "6": 4672.110749990679, "7": 5924.405542085879, "8": 4708.999749971554}, "receiver_prefill_ms": 205.6505000218749, "ttft_ms": 11.552124982699752, "decode_ms": 114.7153329802677}, "total_wall_ms": 44956.97683293838, "ttft_ms": 11.552124982699752, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 247-S, Baie-Comeau", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "5": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1050}, "6": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1010}, "7": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 992}, "8": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5864c0b88a688a045e4eb1d1985303e81b16f7e80826e759450dac2bb9d2e48", "output_hash": "77b7da1d43e7d8815e9e9159ebbd735045bc7f668260ba30b93674f70622b8ec"} | |
| 7128 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5513ed92fbb9a62ad2e3e670", "attempt_id": "0b1358da766f", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:36.360524Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 496, "message_tokens": 387, "message_utf8_bytes": 1022, "cache_tensor_bytes": null, "serialized_payload_bytes": 1022, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 44624.60495799314, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409, "5": 6335.791665944271, "6": 4672.110749990679, "7": 5924.405542085879, "8": 4708.999749971554}, "receiver_prefill_ms": 205.58270800393075, "ttft_ms": 11.726291966624558, "decode_ms": 46.06037505436689}, "total_wall_ms": 44888.58349993825, "ttft_ms": 11.726291966624558, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "15.0054", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "5": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1050}, "6": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1010}, "7": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 992}, "8": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5864c0b88a688a045e4eb1d1985303e81b16f7e80826e759450dac2bb9d2e48", "output_hash": "d13adba73068c847c850237059e0202fc5b91ccacf2e792e9ce5e3b90556501a"} | |
| 7129 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "342492acda34dd62c8927c7a", "attempt_id": "82e71c2e27fb", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:36.640029Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 492, "message_tokens": 387, "message_utf8_bytes": 1022, "cache_tensor_bytes": null, "serialized_payload_bytes": 1022, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 44624.60495799314, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409, "5": 6335.791665944271, "6": 4672.110749990679, "7": 5924.405542085879, "8": 4708.999749971554}, "receiver_prefill_ms": 205.49395796842873, "ttft_ms": 11.706040939316154, "decode_ms": 103.56912505812943}, "total_wall_ms": 44945.98799897358, "ttft_ms": 11.706040939316154, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Priyamvada Sørlie", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "5": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1050}, "6": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1010}, "7": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 992}, "8": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5864c0b88a688a045e4eb1d1985303e81b16f7e80826e759450dac2bb9d2e48", "output_hash": "c5f554196ed23dd71ad995ec89f7142099d524dbb6534cc10d94a0c89d13e792"} | |
| 7130 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "fb7b0cba5561957abf2f9e7d", "attempt_id": "ff7eb9ea83c8", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:36.977139Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 503, "message_tokens": 387, "message_utf8_bytes": 1022, "cache_tensor_bytes": null, "serialized_payload_bytes": 1022, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 44624.60495799314, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409, "5": 6335.791665944271, "6": 4672.110749990679, "7": 5924.405542085879, "8": 4708.999749971554}, "receiver_prefill_ms": 207.89683295879513, "ttft_ms": 11.536833946593106, "decode_ms": 11.517417035065591}, "total_wall_ms": 44856.00374999922, "ttft_ms": 11.536833946593106, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "5": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1050}, "6": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1010}, "7": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 992}, "8": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5864c0b88a688a045e4eb1d1985303e81b16f7e80826e759450dac2bb9d2e48", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7131 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ddae4fd2ea0f6622042da8a1", "attempt_id": "923a18f829ab", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:37.225005Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 498, "message_tokens": 387, "message_utf8_bytes": 1022, "cache_tensor_bytes": null, "serialized_payload_bytes": 1022, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 44624.60495799314, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409, "5": 6335.791665944271, "6": 4672.110749990679, "7": 5924.405542085879, "8": 4708.999749971554}, "receiver_prefill_ms": 206.6919170320034, "ttft_ms": 11.615708004683256, "decode_ms": 11.492042103782296}, "total_wall_ms": 44854.840541025624, "ttft_ms": 11.615708004683256, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "5": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1050}, "6": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1010}, "7": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 992}, "8": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5864c0b88a688a045e4eb1d1985303e81b16f7e80826e759450dac2bb9d2e48", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7132 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e99444682b2647a9d1f225ef", "attempt_id": "1dc4f37b0538", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:37.470529Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 492, "message_tokens": 387, "message_utf8_bytes": 1022, "cache_tensor_bytes": null, "serialized_payload_bytes": 1022, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 44624.60495799314, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409, "5": 6335.791665944271, "6": 4672.110749990679, "7": 5924.405542085879, "8": 4708.999749971554}, "receiver_prefill_ms": 206.48579101543874, "ttft_ms": 11.523665976710618, "decode_ms": 22.95541705098003}, "total_wall_ms": 44865.99916697014, "ttft_ms": 11.523665976710618, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "5": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1050}, "6": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1010}, "7": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 992}, "8": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5864c0b88a688a045e4eb1d1985303e81b16f7e80826e759450dac2bb9d2e48", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | |
| 7133 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c82159bb6d1b2693879010ce", "attempt_id": "9cfc68fe24a1", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:37.727520Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 492, "message_tokens": 387, "message_utf8_bytes": 1022, "cache_tensor_bytes": null, "serialized_payload_bytes": 1022, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 44624.60495799314, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409, "5": 6335.791665944271, "6": 4672.110749990679, "7": 5924.405542085879, "8": 4708.999749971554}, "receiver_prefill_ms": 205.37658303510398, "ttft_ms": 11.629833024926484, "decode_ms": 23.068250040523708}, "total_wall_ms": 44865.222748951055, "ttft_ms": 11.629833024926484, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "5": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1050}, "6": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1010}, "7": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 992}, "8": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5864c0b88a688a045e4eb1d1985303e81b16f7e80826e759450dac2bb9d2e48", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | |
| 7134 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a2a8eaa3f395a27f4ab5cedd", "attempt_id": "75fe32a71ebd", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:37.983494Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 507, "message_tokens": 387, "message_utf8_bytes": 1022, "cache_tensor_bytes": null, "serialized_payload_bytes": 1022, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 44624.60495799314, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409, "5": 6335.791665944271, "6": 4672.110749990679, "7": 5924.405542085879, "8": 4708.999749971554}, "receiver_prefill_ms": 207.95070903841406, "ttft_ms": 11.485417024232447, "decode_ms": 57.63437494169921}, "total_wall_ms": 44902.11654105224, "ttft_ms": 11.485417024232447, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8,010,205", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "5": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1050}, "6": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1010}, "7": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 992}, "8": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5864c0b88a688a045e4eb1d1985303e81b16f7e80826e759450dac2bb9d2e48", "output_hash": "12facbb746e46f5872a48eea64f64dc2cbd9610b1548522078108253d03a7904"} | |
| 7135 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "6f5cf23ff573451d905002c2", "attempt_id": "a49aebdd83cb", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:38.276726Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 500, "message_tokens": 387, "message_utf8_bytes": 1022, "cache_tensor_bytes": null, "serialized_payload_bytes": 1022, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 44624.60495799314, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409, "5": 6335.791665944271, "6": 4672.110749990679, "7": 5924.405542085879, "8": 4708.999749971554}, "receiver_prefill_ms": 206.10175002366304, "ttft_ms": 11.502541950903833, "decode_ms": 57.40062496624887}, "total_wall_ms": 44900.05395794287, "ttft_ms": 11.502541950903833, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,056,150", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "5": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1050}, "6": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1010}, "7": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 992}, "8": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5864c0b88a688a045e4eb1d1985303e81b16f7e80826e759450dac2bb9d2e48", "output_hash": "8262889a8478c7e0ee965f159d9849a3849b412e276f5b979476e2da5b320249"} | |
| 7136 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0660a5cf6123369c78d0112f", "attempt_id": "b83f846951b2", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:38.567754Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 508, "message_tokens": 387, "message_utf8_bytes": 1022, "cache_tensor_bytes": null, "serialized_payload_bytes": 1022, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 44624.60495799314, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409, "5": 6335.791665944271, "6": 4672.110749990679, "7": 5924.405542085879, "8": 4708.999749971554}, "receiver_prefill_ms": 208.3208749536425, "ttft_ms": 11.555084027349949, "decode_ms": 11.706332908943295}, "total_wall_ms": 44856.603916035965, "ttft_ms": 11.555084027349949, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "5": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1050}, "6": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1010}, "7": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 992}, "8": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5864c0b88a688a045e4eb1d1985303e81b16f7e80826e759450dac2bb9d2e48", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7137 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "8ff8a9e150f4804461a35ecf", "attempt_id": "944d46eb4f12", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:38.815297Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 503, "message_tokens": 387, "message_utf8_bytes": 1022, "cache_tensor_bytes": null, "serialized_payload_bytes": 1022, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 44624.60495799314, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409, "5": 6335.791665944271, "6": 4672.110749990679, "7": 5924.405542085879, "8": 4708.999749971554}, "receiver_prefill_ms": 208.48258293699473, "ttft_ms": 11.795250000432134, "decode_ms": 298.95991703961045}, "total_wall_ms": 45144.31745803449, "ttft_ms": 11.795250000432134, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 26}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,914,937 + 1,787,610 + 8,278,225 = 16,980,772", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "5": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1050}, "6": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1010}, "7": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 992}, "8": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.4}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5864c0b88a688a045e4eb1d1985303e81b16f7e80826e759450dac2bb9d2e48", "output_hash": "c5fb5d9b76b7a02439f0acb83233430b95eef4aa96f8df88b9152c3b3e51343c"} | |
| 7138 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "74e98c76a3302f7e1645398b", "attempt_id": "730775e135cc", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:39.350078Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 499, "message_tokens": 387, "message_utf8_bytes": 1022, "cache_tensor_bytes": null, "serialized_payload_bytes": 1022, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 44624.60495799314, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409, "5": 6335.791665944271, "6": 4672.110749990679, "7": 5924.405542085879, "8": 4708.999749971554}, "receiver_prefill_ms": 207.86812505684793, "ttft_ms": 11.652125045657158, "decode_ms": 11.538667022250593}, "total_wall_ms": 44856.26437398605, "ttft_ms": 11.652125045657158, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "5": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1050}, "6": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1010}, "7": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 992}, "8": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5864c0b88a688a045e4eb1d1985303e81b16f7e80826e759450dac2bb9d2e48", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7139 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "30ef5b3e969734698441069d", "attempt_id": "d2f6f26e05e1", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:39.597157Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 503, "message_tokens": 387, "message_utf8_bytes": 1022, "cache_tensor_bytes": null, "serialized_payload_bytes": 1022, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 44624.60495799314, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409, "5": 6335.791665944271, "6": 4672.110749990679, "7": 5924.405542085879, "8": 4708.999749971554}, "receiver_prefill_ms": 208.42470810748637, "ttft_ms": 11.685249977745116, "decode_ms": 11.51199999731034}, "total_wall_ms": 44856.84912500437, "ttft_ms": 11.685249977745116, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "5": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1050}, "6": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1010}, "7": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 992}, "8": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5864c0b88a688a045e4eb1d1985303e81b16f7e80826e759450dac2bb9d2e48", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7140 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "25715c96bfa5e7120815644e", "attempt_id": "c8b533206d63", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:39.845092Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 505, "message_tokens": 387, "message_utf8_bytes": 1022, "cache_tensor_bytes": null, "serialized_payload_bytes": 1022, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 44624.60495799314, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409, "5": 6335.791665944271, "6": 4672.110749990679, "7": 5924.405542085879, "8": 4708.999749971554}, "receiver_prefill_ms": 207.27558399084955, "ttft_ms": 11.788583011366427, "decode_ms": 11.573042022064328}, "total_wall_ms": 44855.82375002559, "ttft_ms": 11.788583011366427, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "5": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1050}, "6": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1010}, "7": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 992}, "8": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5864c0b88a688a045e4eb1d1985303e81b16f7e80826e759450dac2bb9d2e48", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7141 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5b8ad3e54d8c46a7a3708aaf", "attempt_id": "dfd63c4ee7a1", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:46.997516Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 411, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6902.532499982044, "hops": {"1": 6902.532499982044}, "receiver_prefill_ms": 162.03166695777327, "ttft_ms": 11.918416945263743, "decode_ms": 11.814957950264215}, "total_wall_ms": 7088.69258291088, "ttft_ms": 11.918416945263743, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7142 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "25c983ff6d01a61fd9bc3a10", "attempt_id": "82a6c4a15660", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:47.200062Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 418, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6902.532499982044, "hops": {"1": 6902.532499982044}, "receiver_prefill_ms": 163.37533295154572, "ttft_ms": 11.79183297790587, "decode_ms": 11.748916003853083}, "total_wall_ms": 7089.861541986465, "ttft_ms": 11.79183297790587, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7143 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e666bc2522ce9a46111cef56", "attempt_id": "914b684296ff", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:47.403041Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 417, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6902.532499982044, "hops": {"1": 6902.532499982044}, "receiver_prefill_ms": 162.71820897236466, "ttft_ms": 11.816457961685956, "decode_ms": 11.783291003666818}, "total_wall_ms": 7089.226332958788, "ttft_ms": 11.816457961685956, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7144 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c99549ec9e7f764bfd39fcae", "attempt_id": "82c1267cbf76", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:47.605341Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 412, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6902.532499982044, "hops": {"1": 6902.532499982044}, "receiver_prefill_ms": 162.0434580836445, "ttft_ms": 11.916000046767294, "decode_ms": 106.1162919504568}, "total_wall_ms": 7183.022542041726, "ttft_ms": 11.916000046767294, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Priyamvada Sørlie", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "c5f554196ed23dd71ad995ec89f7142099d524dbb6534cc10d94a0c89d13e792"} | |
| 7145 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e30614e72986a0e897a531b7", "attempt_id": "c0ddc23ab826", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:47.901315Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 423, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6902.532499982044, "hops": {"1": 6902.532499982044}, "receiver_prefill_ms": 163.66183292120695, "ttft_ms": 11.917000054381788, "decode_ms": 11.772415949963033}, "total_wall_ms": 7090.299208997749, "ttft_ms": 11.917000054381788, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7146 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "809760b2e49d08da3c32504f", "attempt_id": "bc6711c52254", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:48.104427Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 420, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6902.532499982044, "hops": {"1": 6902.532499982044}, "receiver_prefill_ms": 163.67008304223418, "ttft_ms": 11.832458898425102, "decode_ms": 117.6555419806391}, "total_wall_ms": 7196.079499903135, "ttft_ms": 11.832458898425102, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "WT-26M-9227", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "ef2302e0ab6f5a6951b11463fea177ba766b9d438afcaf6e6101ebfa3ba38aba"} | |
| 7147 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "91115ee512e65260a24be95a", "attempt_id": "11bcf2b8f656", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:48.413022Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 412, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6902.532499982044, "hops": {"1": 6902.532499982044}, "receiver_prefill_ms": 162.16120903845876, "ttft_ms": 11.766124982386827, "decode_ms": 11.783291003666818}, "total_wall_ms": 7088.605041964911, "ttft_ms": 11.766124982386827, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7148 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "3f4d8191f8a1a79816532c58", "attempt_id": "b46fb5cfe4cc", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:48.614653Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 413, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6902.532499982044, "hops": {"1": 6902.532499982044}, "receiver_prefill_ms": 162.3319589998573, "ttft_ms": 11.778834043070674, "decode_ms": 11.786999995820224}, "total_wall_ms": 7088.82975007873, "ttft_ms": 11.778834043070674, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7149 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e55da20ffcdcfedbbd152b0f", "attempt_id": "20baf1b80cb6", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:48.816194Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 427, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6902.532499982044, "hops": {"1": 6902.532499982044}, "receiver_prefill_ms": 163.74241700395942, "ttft_ms": 11.76379097159952, "decode_ms": 105.97279097419232}, "total_wall_ms": 7184.409208944999, "ttft_ms": 11.76379097159952, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,914,937", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "c56851abfdbf8851226a1e71c4911c616a691c490a883eb754e61bac551d004c"} | |
| 7150 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "36267248c59b4bf66952492c", "attempt_id": "2d803970785d", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:49.113299Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 420, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6902.532499982044, "hops": {"1": 6902.532499982044}, "receiver_prefill_ms": 163.74362504575402, "ttft_ms": 11.74829201772809, "decode_ms": 94.459000043571}, "total_wall_ms": 7172.85324994009, "ttft_ms": 11.74829201772809, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "15828866", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "c9d49be6f876880a6dfe30589ff0b746c048ebaf1842118a883f5503a349a8b6"} | |
| 7151 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "455749589724001613fb9977", "attempt_id": "edf9e1a9d292", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:49.398808Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 430, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6902.532499982044, "hops": {"1": 6902.532499982044}, "receiver_prefill_ms": 163.61391602549702, "ttft_ms": 11.799250030890107, "decode_ms": 11.838750098831952}, "total_wall_ms": 7090.168667025864, "ttft_ms": 11.799250030890107, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7152 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "930fdfaeba90af289a75cb42", "attempt_id": "210167b42167", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:49.601819Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 423, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6902.532499982044, "hops": {"1": 6902.532499982044}, "receiver_prefill_ms": 163.16475009080023, "ttft_ms": 12.144459062255919, "decode_ms": 82.49591593630612}, "total_wall_ms": 7160.804915940389, "ttft_ms": 12.144459062255919, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6914937", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "534d40ded32f784c68307dd2386faed2a27bf39dcc27321ee6985e42ccd285e5"} | |
| 7153 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c83c1e1d1b2d5fc9ed136f8b", "attempt_id": "b24ebe69d32d", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:49.875452Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 420, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6902.532499982044, "hops": {"1": 6902.532499982044}, "receiver_prefill_ms": 163.4248330956325, "ttft_ms": 11.745458003133535, "decode_ms": 11.822083033621311}, "total_wall_ms": 7089.925166917965, "ttft_ms": 11.745458003133535, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7154 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a413e661e3f29a3499aa4cef", "attempt_id": "14096fe6c9a7", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:50.078611Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 423, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6902.532499982044, "hops": {"1": 6902.532499982044}, "receiver_prefill_ms": 162.6319580245763, "ttft_ms": 12.003249954432249, "decode_ms": 11.87183300498873}, "total_wall_ms": 7089.54525005538, "ttft_ms": 12.003249954432249, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7155 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7d67252d68708916ce139c40", "attempt_id": "8b7a0833495b", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:50.281170Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 425, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6902.532499982044, "hops": {"1": 6902.532499982044}, "receiver_prefill_ms": 163.75304199755192, "ttft_ms": 11.849457980133593, "decode_ms": 11.84250006917864}, "total_wall_ms": 7090.372124919668, "ttft_ms": 11.849457980133593, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7156 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "32f0aea542e323974c082c53", "attempt_id": "56b00936af11", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:54.207317Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 401, "message_tokens": 299, "message_utf8_bytes": 856, "cache_tensor_bytes": null, "serialized_payload_bytes": 856, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10623.747832956724, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798}, "receiver_prefill_ms": 185.11791701894253, "ttft_ms": 11.538624996319413, "decode_ms": 11.575874988920987}, "total_wall_ms": 10832.374625024386, "ttft_ms": 11.538624996319413, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ba14cf3ffcb23a84821d65b144b85efdb6c26697d433b2af58366827b4c8eba4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7157 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "52e00003bf89a2dd0db49ee0", "attempt_id": "6c3e2fed0be6", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:54.432105Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 408, "message_tokens": 299, "message_utf8_bytes": 856, "cache_tensor_bytes": null, "serialized_payload_bytes": 856, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10623.747832956724, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798}, "receiver_prefill_ms": 187.07454099785537, "ttft_ms": 11.601374950259924, "decode_ms": 11.515165911987424}, "total_wall_ms": 10834.40662396606, "ttft_ms": 11.601374950259924, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ba14cf3ffcb23a84821d65b144b85efdb6c26697d433b2af58366827b4c8eba4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7158 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "076477e095094cf954531adc", "attempt_id": "6feeefafeacf", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:54.658401Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 407, "message_tokens": 299, "message_utf8_bytes": 856, "cache_tensor_bytes": null, "serialized_payload_bytes": 856, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10623.747832956724, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798}, "receiver_prefill_ms": 185.49241696018726, "ttft_ms": 11.523708933964372, "decode_ms": 11.476584011688828}, "total_wall_ms": 10832.613540929742, "ttft_ms": 11.523708933964372, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ba14cf3ffcb23a84821d65b144b85efdb6c26697d433b2af58366827b4c8eba4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7159 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "80df95069eef4bba0c71069b", "attempt_id": "9441a5d15ba2", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:54.883030Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 403, "message_tokens": 299, "message_utf8_bytes": 856, "cache_tensor_bytes": null, "serialized_payload_bytes": 856, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10623.747832956724, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798}, "receiver_prefill_ms": 185.39558397606015, "ttft_ms": 11.498625040985644, "decode_ms": 103.44258300028741}, "total_wall_ms": 10924.560333020054, "ttft_ms": 11.498625040985644, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Priyamvada Sørlie", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ba14cf3ffcb23a84821d65b144b85efdb6c26697d433b2af58366827b4c8eba4", "output_hash": "c5f554196ed23dd71ad995ec89f7142099d524dbb6534cc10d94a0c89d13e792"} | |
| 7160 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f7ef7c35ce0bb2b23a36107c", "attempt_id": "f85e1169a0c5", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:55.198965Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 414, "message_tokens": 299, "message_utf8_bytes": 856, "cache_tensor_bytes": null, "serialized_payload_bytes": 856, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10623.747832956724, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798}, "receiver_prefill_ms": 182.9623329686001, "ttft_ms": 11.450292076915503, "decode_ms": 11.449708021245897}, "total_wall_ms": 10829.991040984169, "ttft_ms": 11.450292076915503, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ba14cf3ffcb23a84821d65b144b85efdb6c26697d433b2af58366827b4c8eba4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7161 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "47ba67bdea77540ff06ab780", "attempt_id": "ca09a65cbbf2", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:55.420757Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 409, "message_tokens": 299, "message_utf8_bytes": 856, "cache_tensor_bytes": null, "serialized_payload_bytes": 856, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10623.747832956724, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798}, "receiver_prefill_ms": 183.7443329859525, "ttft_ms": 11.527374968864024, "decode_ms": 11.427958030253649}, "total_wall_ms": 10830.80004202202, "ttft_ms": 11.527374968864024, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ba14cf3ffcb23a84821d65b144b85efdb6c26697d433b2af58366827b4c8eba4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7162 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b341bb9b289354fbbef778a0", "attempt_id": "efc9f2707e87", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:55.642982Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 403, "message_tokens": 299, "message_utf8_bytes": 856, "cache_tensor_bytes": null, "serialized_payload_bytes": 856, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10623.747832956724, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798}, "receiver_prefill_ms": 184.20104193501174, "ttft_ms": 11.518582934513688, "decode_ms": 11.543250060640275}, "total_wall_ms": 10831.360082956962, "ttft_ms": 11.518582934513688, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ba14cf3ffcb23a84821d65b144b85efdb6c26697d433b2af58366827b4c8eba4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7163 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "808fe4967e57b1088dbbd2fb", "attempt_id": "ff20fe126819", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:55.865367Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 403, "message_tokens": 299, "message_utf8_bytes": 856, "cache_tensor_bytes": null, "serialized_payload_bytes": 856, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10623.747832956724, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798}, "receiver_prefill_ms": 186.58191699068993, "ttft_ms": 11.780000058934093, "decode_ms": 11.600499972701073}, "total_wall_ms": 10834.17795796413, "ttft_ms": 11.780000058934093, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ba14cf3ffcb23a84821d65b144b85efdb6c26697d433b2af58366827b4c8eba4", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | |
| 7164 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f3fc6c39901c8b347be8d999", "attempt_id": "f48ff9ebe6c6", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:56.090508Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 418, "message_tokens": 299, "message_utf8_bytes": 856, "cache_tensor_bytes": null, "serialized_payload_bytes": 856, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10623.747832956724, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798}, "receiver_prefill_ms": 184.23929205164313, "ttft_ms": 11.577625060454011, "decode_ms": 57.389084016904235}, "total_wall_ms": 10877.343916916288, "ttft_ms": 11.577625060454011, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,914,937", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ba14cf3ffcb23a84821d65b144b85efdb6c26697d433b2af58366827b4c8eba4", "output_hash": "c56851abfdbf8851226a1e71c4911c616a691c490a883eb754e61bac551d004c"} | |
| 7165 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0fd7e8fcf4255c723aee3f42", "attempt_id": "271530ae39d2", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:56.359377Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 411, "message_tokens": 299, "message_utf8_bytes": 856, "cache_tensor_bytes": null, "serialized_payload_bytes": 856, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10623.747832956724, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798}, "receiver_prefill_ms": 187.27079196833074, "ttft_ms": 11.509082978591323, "decode_ms": 57.34191706869751}, "total_wall_ms": 10880.241040955298, "ttft_ms": 11.509082978591323, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7,000,000", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ba14cf3ffcb23a84821d65b144b85efdb6c26697d433b2af58366827b4c8eba4", "output_hash": "a8f19157bfa97ae9789ef71ec65944fe20e98491b7b0c2aa047d68bf92a3e7fd"} | |
| 7166 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "301fe2a9b9d7f0292e06b499", "attempt_id": "29911531c148", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:56.630954Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 419, "message_tokens": 299, "message_utf8_bytes": 856, "cache_tensor_bytes": null, "serialized_payload_bytes": 856, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10623.747832956724, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798}, "receiver_prefill_ms": 181.3983329338953, "ttft_ms": 11.585332918912172, "decode_ms": 11.511708959005773}, "total_wall_ms": 10828.584041912109, "ttft_ms": 11.585332918912172, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ba14cf3ffcb23a84821d65b144b85efdb6c26697d433b2af58366827b4c8eba4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7167 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d7600423fe9bb67750d9c6eb", "attempt_id": "736405ccda0f", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:56.851089Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 414, "message_tokens": 299, "message_utf8_bytes": 856, "cache_tensor_bytes": null, "serialized_payload_bytes": 856, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10623.747832956724, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798}, "receiver_prefill_ms": 184.55691705457866, "ttft_ms": 11.523167020641267, "decode_ms": 57.48795799445361}, "total_wall_ms": 10877.674916875549, "ttft_ms": 11.523167020641267, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,914,937", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ba14cf3ffcb23a84821d65b144b85efdb6c26697d433b2af58366827b4c8eba4", "output_hash": "c56851abfdbf8851226a1e71c4911c616a691c490a883eb754e61bac551d004c"} | |
| 7168 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d8a893b6b7b40dcd1750232b", "attempt_id": "087350c8c1a0", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:57.120063Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 410, "message_tokens": 299, "message_utf8_bytes": 856, "cache_tensor_bytes": null, "serialized_payload_bytes": 856, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10623.747832956724, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798}, "receiver_prefill_ms": 185.09566702414304, "ttft_ms": 11.490083066746593, "decode_ms": 11.453374987468123}, "total_wall_ms": 10832.114374963567, "ttft_ms": 11.490083066746593, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ba14cf3ffcb23a84821d65b144b85efdb6c26697d433b2af58366827b4c8eba4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7169 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e26ea3805eb9a9309fe7295b", "attempt_id": "f92eeca785e2", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:57.343543Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 414, "message_tokens": 299, "message_utf8_bytes": 856, "cache_tensor_bytes": null, "serialized_payload_bytes": 856, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10623.747832956724, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798}, "receiver_prefill_ms": 184.01579197961837, "ttft_ms": 11.505834059789777, "decode_ms": 11.486624949611723}, "total_wall_ms": 10831.102123949677, "ttft_ms": 11.505834059789777, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ba14cf3ffcb23a84821d65b144b85efdb6c26697d433b2af58366827b4c8eba4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7170 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "8b7d6b742cbb2bab36003ae9", "attempt_id": "90cb0f935966", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:57.565991Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 416, "message_tokens": 299, "message_utf8_bytes": 856, "cache_tensor_bytes": null, "serialized_payload_bytes": 856, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10623.747832956724, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798}, "receiver_prefill_ms": 186.47879210766405, "ttft_ms": 11.604208033531904, "decode_ms": 11.550666997209191}, "total_wall_ms": 10833.764332928695, "ttft_ms": 11.604208033531904, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ba14cf3ffcb23a84821d65b144b85efdb6c26697d433b2af58366827b4c8eba4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7171 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "282648cc1ad692181a94033b", "attempt_id": "f3a7c9017338", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:06.145574Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 427, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18975.824540830217, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292}, "receiver_prefill_ms": 183.1518328981474, "ttft_ms": 11.601875070482492, "decode_ms": 11.466708034276962}, "total_wall_ms": 19182.455581845716, "ttft_ms": 11.601875070482492, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7172 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "2efd215d6f379713b19ef1c5", "attempt_id": "aac35836d7d5", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:06.368425Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 434, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18975.824540830217, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292}, "receiver_prefill_ms": 184.1881669824943, "ttft_ms": 11.533332988619804, "decode_ms": 11.421707924455404}, "total_wall_ms": 19183.356457855552, "ttft_ms": 11.533332988619804, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7173 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a199f98122c4ea0436580d6e", "attempt_id": "b61ed8163389", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:06.591094Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 433, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18975.824540830217, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292}, "receiver_prefill_ms": 183.53512499015778, "ttft_ms": 11.808916926383972, "decode_ms": 11.57833298202604}, "total_wall_ms": 19183.29666578211, "ttft_ms": 11.808916926383972, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7174 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ea875e8491bf9ad2111e80b0", "attempt_id": "a2079ddcb751", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:06.814222Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 429, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18975.824540830217, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292}, "receiver_prefill_ms": 183.72191698290408, "ttft_ms": 11.70645805541426, "decode_ms": 103.66066603455693}, "total_wall_ms": 19275.43687389698, "ttft_ms": 11.70645805541426, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Priyamvada Sørlie", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "c5f554196ed23dd71ad995ec89f7142099d524dbb6534cc10d94a0c89d13e792"} | |
| 7175 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d1146bf9fbcb72926ca626e1", "attempt_id": "e942b88622b5", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:07.130065Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 440, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18975.824540830217, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292}, "receiver_prefill_ms": 184.64200000744313, "ttft_ms": 11.569666909053922, "decode_ms": 11.474541970528662}, "total_wall_ms": 19183.910374878906, "ttft_ms": 11.569666909053922, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7176 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c424cebb58afa5480b073e7a", "attempt_id": "8dbcf864c9ef", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:07.353743Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 435, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18975.824540830217, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292}, "receiver_prefill_ms": 185.20074989646673, "ttft_ms": 11.636749957688153, "decode_ms": 11.452458100393414}, "total_wall_ms": 19184.493873850442, "ttft_ms": 11.636749957688153, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7177 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0cf9fa8bf456be126d1a70ac", "attempt_id": "5bf132d61906", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:07.577705Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 429, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18975.824540830217, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292}, "receiver_prefill_ms": 183.41195897664875, "ttft_ms": 11.66979200206697, "decode_ms": 11.54587499331683}, "total_wall_ms": 19182.796790846623, "ttft_ms": 11.66979200206697, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7178 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "877dbce9aad6b105b61fbc39", "attempt_id": "7e1897b6ffb6", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:07.799523Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 429, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18975.824540830217, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292}, "receiver_prefill_ms": 185.62191596720368, "ttft_ms": 11.542417109012604, "decode_ms": 11.489874916151166}, "total_wall_ms": 19184.848331846297, "ttft_ms": 11.542417109012604, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | |
| 7179 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9bf21bf5e9cd7b14dbf52c10", "attempt_id": "0a036e322eb1", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:08.023148Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 444, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18975.824540830217, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292}, "receiver_prefill_ms": 184.39075001515448, "ttft_ms": 11.536792037077248, "decode_ms": 57.62087507173419}, "total_wall_ms": 19229.782623820938, "ttft_ms": 11.536792037077248, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,914,937", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "c56851abfdbf8851226a1e71c4911c616a691c490a883eb754e61bac551d004c"} | |
| 7180 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4991735f0c6d669ddb410cc9", "attempt_id": "8c0d7c661a06", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:08.292353Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 437, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18975.824540830217, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292}, "receiver_prefill_ms": 183.92350000794977, "ttft_ms": 11.530791060067713, "decode_ms": 57.63629195280373}, "total_wall_ms": 19229.3029158609, "ttft_ms": 11.530791060067713, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7,000,000", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "a8f19157bfa97ae9789ef71ec65944fe20e98491b7b0c2aa047d68bf92a3e7fd"} | |
| 7181 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c47c24168ce645996e58b291", "attempt_id": "46f84613dd6d", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:08.561144Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 445, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18975.824540830217, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292}, "receiver_prefill_ms": 185.29229098930955, "ttft_ms": 11.526333983056247, "decode_ms": 11.494959006085992}, "total_wall_ms": 19184.505624813028, "ttft_ms": 11.526333983056247, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7182 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "6393fcd54e83bd5591ea952e", "attempt_id": "b729ecb000cf", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:08.784875Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 440, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18975.824540830217, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292}, "receiver_prefill_ms": 184.37124998308718, "ttft_ms": 11.541667045094073, "decode_ms": 57.602541986852884}, "total_wall_ms": 19229.72504084464, "ttft_ms": 11.541667045094073, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,914,937", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "c56851abfdbf8851226a1e71c4911c616a691c490a883eb754e61bac551d004c"} | |
| 7183 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9a916e02221f5f654f3ea10a", "attempt_id": "773b8ba96a14", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:09.054030Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 436, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18975.824540830217, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292}, "receiver_prefill_ms": 185.26408297475427, "ttft_ms": 11.60491700284183, "decode_ms": 11.488249991089106}, "total_wall_ms": 19184.685706859455, "ttft_ms": 11.60491700284183, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7184 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "fabb394ca93a9fb5207b7189", "attempt_id": "a9469949540a", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:09.278464Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 440, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18975.824540830217, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292}, "receiver_prefill_ms": 184.82229195069522, "ttft_ms": 11.583750019781291, "decode_ms": 11.56625000294298}, "total_wall_ms": 19184.16024884209, "ttft_ms": 11.583750019781291, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7185 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "13d5741a3d04d8a6501b3f92", "attempt_id": "e7f662333103", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:09.502472Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 442, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18975.824540830217, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292}, "receiver_prefill_ms": 184.81195799540728, "ttft_ms": 11.778416926972568, "decode_ms": 11.68158301152289}, "total_wall_ms": 19184.613832854666, "ttft_ms": 11.778416926972568, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7186 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "986b57137b9ce8fe0a232066", "attempt_id": "70d8121f81eb", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:27.075314Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 427, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36320.24874887429, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292, "5": 4598.389083053917, "6": 4072.139750001952, "7": 4599.793374887668, "8": 4074.102000100538}, "receiver_prefill_ms": 182.95579100959003, "ttft_ms": 11.527625028975308, "decode_ms": 11.49016700219363}, "total_wall_ms": 36526.62808180321, "ttft_ms": 11.527625028975308, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7187 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "68fc80b4320f08c4739af3c0", "attempt_id": "a65a82a1bf8f", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:27.297865Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 434, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36320.24874887429, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292, "5": 4598.389083053917, "6": 4072.139750001952, "7": 4599.793374887668, "8": 4074.102000100538}, "receiver_prefill_ms": 182.6196250040084, "ttft_ms": 11.574708973057568, "decode_ms": 11.532500036992133}, "total_wall_ms": 36526.34958282579, "ttft_ms": 11.574708973057568, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7188 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "af761bf2968d73dc291319e3", "attempt_id": "d4da182e198a", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:27.519735Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 433, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36320.24874887429, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292, "5": 4598.389083053917, "6": 4072.139750001952, "7": 4599.793374887668, "8": 4074.102000100538}, "receiver_prefill_ms": 183.0052910372615, "ttft_ms": 11.547958012670279, "decode_ms": 11.56937493942678}, "total_wall_ms": 36526.74520784058, "ttft_ms": 11.547958012670279, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7189 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "31f6324d4005a81bb6e87b23", "attempt_id": "f5958669933b", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:27.742047Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 429, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36320.24874887429, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292, "5": 4598.389083053917, "6": 4072.139750001952, "7": 4599.793374887668, "8": 4074.102000100538}, "receiver_prefill_ms": 184.25354093778878, "ttft_ms": 11.528333998285234, "decode_ms": 103.85308298282325}, "total_wall_ms": 36620.2802908374, "ttft_ms": 11.528333998285234, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Priyamvada Sørlie", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "c5f554196ed23dd71ad995ec89f7142099d524dbb6534cc10d94a0c89d13e792"} | |
| 7190 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a23ad7ecff07967e17a704de", "attempt_id": "20564f11cdaa", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:28.057282Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 440, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36320.24874887429, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292, "5": 4598.389083053917, "6": 4072.139750001952, "7": 4599.793374887668, "8": 4074.102000100538}, "receiver_prefill_ms": 184.3003750545904, "ttft_ms": 11.527125025168061, "decode_ms": 11.529542040079832}, "total_wall_ms": 36527.97053998802, "ttft_ms": 11.527125025168061, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7191 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0030acdb6dbf81d0d87ea3c8", "attempt_id": "aff3b9c61732", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:28.280243Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 435, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36320.24874887429, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292, "5": 4598.389083053917, "6": 4072.139750001952, "7": 4599.793374887668, "8": 4074.102000100538}, "receiver_prefill_ms": 186.0141250072047, "ttft_ms": 11.580625083297491, "decode_ms": 11.531542055308819}, "total_wall_ms": 36529.73383292556, "ttft_ms": 11.580625083297491, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7192 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "3c1b90a9dc1fe77b57325b3f", "attempt_id": "de5809ce296a", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:28.505046Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 429, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36320.24874887429, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292, "5": 4598.389083053917, "6": 4072.139750001952, "7": 4599.793374887668, "8": 4074.102000100538}, "receiver_prefill_ms": 183.01004194654524, "ttft_ms": 11.83879200834781, "decode_ms": 11.49150007404387}, "total_wall_ms": 36526.95266494993, "ttft_ms": 11.83879200834781, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7193 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "702bd4b1cb5dcffaa41e0b10", "attempt_id": "e37327299fcf", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:28.726653Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 429, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36320.24874887429, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292, "5": 4598.389083053917, "6": 4072.139750001952, "7": 4599.793374887668, "8": 4074.102000100538}, "receiver_prefill_ms": 183.0625410657376, "ttft_ms": 11.526082991622388, "decode_ms": 11.536041973158717}, "total_wall_ms": 36526.72833192628, "ttft_ms": 11.526082991622388, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | |
| 7194 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f42418df841e1cee7a2ba592", "attempt_id": "41382625009e", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:28.947685Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 444, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36320.24874887429, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292, "5": 4598.389083053917, "6": 4072.139750001952, "7": 4599.793374887668, "8": 4074.102000100538}, "receiver_prefill_ms": 184.81733393855393, "ttft_ms": 11.634916998445988, "decode_ms": 57.519542053341866}, "total_wall_ms": 36574.61024890654, "ttft_ms": 11.634916998445988, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,914,937", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "c56851abfdbf8851226a1e71c4911c616a691c490a883eb754e61bac551d004c"} | |
| 7195 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9ff142be453fac0f188c51ee", "attempt_id": "6a004181a6b0", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:29.216944Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 437, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36320.24874887429, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292, "5": 4598.389083053917, "6": 4072.139750001952, "7": 4599.793374887668, "8": 4074.102000100538}, "receiver_prefill_ms": 184.62754203937948, "ttft_ms": 11.469374992884696, "decode_ms": 57.3348329635337}, "total_wall_ms": 36574.054081807844, "ttft_ms": 11.469374992884696, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7,000,000", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "a8f19157bfa97ae9789ef71ec65944fe20e98491b7b0c2aa047d68bf92a3e7fd"} | |
| 7196 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "da71969e078df5a4d0ace118", "attempt_id": "95f02332134a", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:29.485706Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 445, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36320.24874887429, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292, "5": 4598.389083053917, "6": 4072.139750001952, "7": 4599.793374887668, "8": 4074.102000100538}, "receiver_prefill_ms": 183.98929201066494, "ttft_ms": 11.605625040829182, "decode_ms": 11.454334016889334}, "total_wall_ms": 36527.655539801344, "ttft_ms": 11.605625040829182, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7197 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "523abb46c407a1c204e938ad", "attempt_id": "552d6ea44f3e", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:29.709208Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 440, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36320.24874887429, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292, "5": 4598.389083053917, "6": 4072.139750001952, "7": 4599.793374887668, "8": 4074.102000100538}, "receiver_prefill_ms": 185.88920799084008, "ttft_ms": 11.528583010658622, "decode_ms": 57.80966591555625}, "total_wall_ms": 36575.850290828384, "ttft_ms": 11.528583010658622, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,914,937", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "c56851abfdbf8851226a1e71c4911c616a691c490a883eb754e61bac551d004c"} | |
| 7198 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "42189f91a606656db2179f32", "attempt_id": "b61e496c6038", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:29.980312Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 436, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36320.24874887429, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292, "5": 4598.389083053917, "6": 4072.139750001952, "7": 4599.793374887668, "8": 4074.102000100538}, "receiver_prefill_ms": 183.3075419999659, "ttft_ms": 11.470124940387905, "decode_ms": 11.47279201541096}, "total_wall_ms": 36526.87003987376, "ttft_ms": 11.470124940387905, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7199 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c33c52f5ed4bda6114c830fb", "attempt_id": "d864585fea94", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:30.202414Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 440, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36320.24874887429, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292, "5": 4598.389083053917, "6": 4072.139750001952, "7": 4599.793374887668, "8": 4074.102000100538}, "receiver_prefill_ms": 184.77762502152473, "ttft_ms": 11.464999988675117, "decode_ms": 11.751624988391995}, "total_wall_ms": 36528.57462386601, "ttft_ms": 11.464999988675117, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7200 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f0e6ff093389e04dd8275310", "attempt_id": "2c20470b933f", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:30.425778Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 442, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36320.24874887429, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292, "5": 4598.389083053917, "6": 4072.139750001952, "7": 4599.793374887668, "8": 4074.102000100538}, "receiver_prefill_ms": 183.4474999923259, "ttft_ms": 11.52937498409301, "decode_ms": 11.499374988488853}, "total_wall_ms": 36527.099415892735, "ttft_ms": 11.52937498409301, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
modified
runs/raw/E5_core.jsonl
+556 −0
Large diff (559 lines) is not loaded by default to keep the page fast.Load diff
added
runs/raw/chains/E4_core_syn_03021_2000_A4_closed_qwen3b_llama3b.json
+278 −0
Large diff (279 lines) is not loaded by default to keep the page fast.Load diff
added
runs/raw/chains/E4_core_syn_03021_2000_A4_repairable_qwen3b.json
+285 −0
Large diff (286 lines) is not loaded by default to keep the page fast.Load diff
added
runs/raw/chains/E4_core_syn_03021_2000_A5_closed_qwen3b.json
+278 −0
Large diff (279 lines) is not loaded by default to keep the page fast.Load diff
added
runs/raw/chains/E4_core_syn_03021_2000_A5_closed_qwen3b_llama3b.json
+278 −0
Large diff (279 lines) is not loaded by default to keep the page fast.Load diff
added
runs/raw/chains/E4_core_syn_03021_2000_A5_repairable_qwen3b.json
+285 −0
Large diff (286 lines) is not loaded by default to keep the page fast.Load diff
added
runs/raw/chains/E4_core_syn_03024_2000_A4_closed_qwen3b.json
+278 −0
Large diff (279 lines) is not loaded by default to keep the page fast.Load diff
added
runs/raw/chains/E4_core_syn_03024_2000_A4_closed_qwen3b_llama3b.json
+278 −0
Large diff (279 lines) is not loaded by default to keep the page fast.Load diff
added
runs/raw/chains/E4_core_syn_03024_2000_A4_repairable_qwen3b.json
+285 −0
Large diff (286 lines) is not loaded by default to keep the page fast.Load diff
added
runs/raw/chains/E4_core_syn_03024_2000_A5_closed_qwen3b.json
+278 −0
Large diff (279 lines) is not loaded by default to keep the page fast.Load diff
added
runs/raw/chains/E4_core_syn_03024_2000_A5_closed_qwen3b_llama3b.json
+278 −0
Large diff (279 lines) is not loaded by default to keep the page fast.Load diff
added
runs/raw/chains/E4_core_syn_03024_2000_A5_repairable_qwen3b.json
+285 −0
Large diff (286 lines) is not loaded by default to keep the page fast.Load diff
added
runs/raw/chains/E4_core_syn_03027_2000_A4_closed_qwen3b.json
+278 −0
Large diff (279 lines) is not loaded by default to keep the page fast.Load diff
added
runs/raw/chains/E4_core_syn_03027_2000_A4_closed_qwen3b_llama3b.json
+278 −0
Large diff (279 lines) is not loaded by default to keep the page fast.Load diff
added
runs/raw/chains/E4_core_syn_03027_2000_A4_repairable_qwen3b.json
+285 −0
Large diff (286 lines) is not loaded by default to keep the page fast.Load diff
added
runs/raw/chains/E4_core_syn_03027_2000_A5_closed_qwen3b.json
+278 −0
Large diff (279 lines) is not loaded by default to keep the page fast.Load diff
added
runs/raw/chains/E4_core_syn_03027_2000_A5_closed_qwen3b_llama3b.json
+278 −0
Large diff (279 lines) is not loaded by default to keep the page fast.Load diff
added
runs/raw/chains/E4_core_syn_03027_2000_A5_repairable_qwen3b.json
+285 −0
Large diff (286 lines) is not loaded by default to keep the page fast.Load diff
modified
runs/raw/remote/E4_core_shard0_m3u96b.jsonl
+975 −0
Large diff (978 lines) is not loaded by default to keep the page fast.Load diff
modified
src/wp30/analysis/analyze.py
+50 −20
Large diff (120 lines) is not loaded by default to keep the page fast.Load diff
modified
src/wp30/analysis/latex_tables.py
+28 −0
Large diff (34 lines) is not loaded by default to keep the page fast.Load diff
modified
src/wp30/analysis/load.py
+3 −1
Large diff (17 lines) is not loaded by default to keep the page fast.Load diff